Apr 10 10:25:54 devstack cinder-volume[72387]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 10 10:25:54 devstack cinder-volume[72387]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 10:25:54 devstack cinder-volume[72387]: we strongly recommend against using it for new projects.
Apr 10 10:25:54 devstack cinder-volume[72387]: If you are already using Eventlet, we recommend migrating to a different
Apr 10 10:25:54 devstack cinder-volume[72387]: framework.  For more detail see
Apr 10 10:25:54 devstack cinder-volume[72387]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 10:25:54 devstack cinder-volume[72387]:   import eventlet  # noqa
Apr 10 10:25:55 devstack cinder-volume[72387]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 10:25:55 devstack cinder-volume[72387]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 10:25:55 devstack cinder-volume[72387]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO dbcounter [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Registered counter for database cinder
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_db.sqlalchemy.engines [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG dbcounter [-] [72387] Writer thread running {{(pid=72387) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO cinder.rpc [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO cinder.rpc [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_db.sqlalchemy.engines [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO cinder.volume.manager [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Determined volume DB was empty at startup.
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG cinder.volume.manager [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72387) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO cinder.volume.manager [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 10 10:25:56 devstack cinder-volume[72387]: WARNING stevedore.named [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 10:25:56 devstack cinder-volume[72387]: WARNING castellan.key_manager [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 10:25:56 devstack cinder-volume[72387]: WARNING cinder.keymgr.conf_key_mgr [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG cinder.volume.drivers.lvm [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72387) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_concurrency.processutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72387) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_concurrency.processutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.259s {{(pid=72387) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_db.sqlalchemy.engines [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO cinder.rpc [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO cinder.rpc [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 10 10:25:56 devstack cinder-volume[72387]: WARNING stevedore.named [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 10:25:56 devstack cinder-volume[72387]: WARNING castellan.key_manager [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO cinder.volume.manager [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_db.sqlalchemy.engines [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:25:56 devstack cinder-volume[72387]: INFO oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Starting 1 workers
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Started child 72487 {{(pid=72387) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Full set of CONF: {{(pid=72387) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] ******************************************************************************** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Configuration options gathered from: {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 10 10:25:56 devstack cinder-volume[72487]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] ================================================================================ {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 10 10:25:56 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] allow_availability_zone_fallback = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] allow_compression_on_image_upload = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] allowed_direct_url_schemes     = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] api_rate_limit                 = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] auth_strategy                  = keystone {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] az_cache_duration              = 3600 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_availability_zone      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_host                   = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_name                   = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_stats_polling_interval = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backup_api_class               = cinder.backup.api.API {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backup_name_template           = backup-%s {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backup_use_same_host           = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backup_use_temp_snapshot       = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] chap_password                  = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] chap_username                  =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_internal_tenant_project_id = 4439587e428a4e2d950864ee175af6d6 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_internal_tenant_user_id = d4859b7fc3af4b67aca303884ede3606 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cloned_volume_same_az          = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cluster                        = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] compression_format             = gzip {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] config_dir                     = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] config_source                  = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] control_exchange               = openstack {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] debug                          = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] default_availability_zone      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] default_group_type             = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] default_volume_type            = lvmdriver-1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] disk_geometry                  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] driver_client_cert             = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] driver_client_cert_key         = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] driver_data_namespace          = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] driver_ssl_cert_path           = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] driver_ssl_cert_verify         = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] driver_use_ssl                 = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] enable_force_upload            = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] enable_new_services            = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] enable_unsupported_driver      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] enforce_multipath_for_image_xfer = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] filter_function                = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_api_insecure            = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_api_servers             = ['http://192.168.122.164/image'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_api_ssl_compression     = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_ca_certificates_file    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_certfile                = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_keyfile                 = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_num_retries             = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance_request_timeout         = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] goodness_function              = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] graceful_shutdown_timeout      = 5 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] group_api_class                = cinder.group.api.API {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] host                           = devstack {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_compress_on_upload       = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_conversion_address_space_limit = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_conversion_cpu_limit     = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_conversion_disable       = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_upload_use_cinder_backend = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_upload_use_internal_tenant = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_volume_cache_enabled     = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_volume_cache_max_count   = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] image_volume_cache_max_size_gb = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] init_host_max_objects_retrieval = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] iscsi_target_flags             =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] iscsi_write_cache              = on {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] iser_helper                    = tgtadm {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] iser_ip_address                = 192.168.122.164 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] iser_port                      = 3260 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_color                      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_config_append              = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_dir                        = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_file                       = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_options                    = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_rotate_interval            = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_rotate_interval_type       = days {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] log_rotation_type              = none {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] max_age                        = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] max_logfile_count              = 30 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] max_logfile_size_mb            = 200 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] max_over_subscription_ratio    = 20.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] message_reap_interval          = 86400 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] message_ttl                    = 2592000 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] migration_create_volume_timeout_secs = 300 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] monkey_patch                   = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] monkey_patch_modules           = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] my_ip                          = 192.168.122.164 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] no_snapshot_gb_quota           = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] num_iser_scan_tries            = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] num_shell_tries                = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] num_volume_device_scan_tries   = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] nvmeof_conn_info_version       = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] nvmet_ns_id                    = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] nvmet_port_id                  = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] osapi_max_limit                = 1000 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] osapi_volume_ext_list          = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] osapi_volume_listen_port       = 8776 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] osapi_volume_use_ssl           = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] osapi_volume_workers           = 2 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] per_volume_size_limit          = -1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] periodic_fuzzy_delay           = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] periodic_interval              = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] public_endpoint                = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] publish_errors                 = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] quota_backup_gigabytes         = 1000 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] quota_backups                  = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] quota_gigabytes                = 1000 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] quota_groups                   = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] quota_snapshots                = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] quota_volumes                  = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] rate_limit_burst               = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] rate_limit_except_level        = CRITICAL {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] rate_limit_interval            = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] reinit_driver_count            = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] replication_device             = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] report_discard_supported       = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] report_interval                = 120 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] reservation_clean_interval     = 86400 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] reservation_expire             = 86400 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] reserved_image_namespaces      = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] reserved_percentage            = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] rpc_response_timeout           = 120 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] run_external_periodic_tasks    = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] scst_target_driver             = iscsi {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] scst_target_iqn_name           = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_down_time              = 720 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] shell_completion               = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] snapshot_name_template         = snapshot-%s {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] snapshot_same_host             = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] split_loggers                  = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] state_path                     = /opt/stack/data/cinder {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] storage_availability_zone      = nova {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] storage_protocol               = iSCSI {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] syslog_log_facility            = LOG_USER {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] target_helper                  = lioadm {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] target_ip_address              = 192.168.122.164 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] target_port                    = 3260 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] target_protocol                = iscsi {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] target_secondary_ip_addresses  = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] trace_flags                    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] transport_url                  = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] until_refresh                  = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] use_chap_auth                  = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] use_default_quota_class        = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] use_journal                    = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] use_json                       = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] use_multipath_for_image_xfer   = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] use_stderr                     = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] use_syslog                     = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] verify_glance_signatures       = enabled {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_api_class               = cinder.volume.api.API {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_backend_name            = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_clear                   = zero {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_clear_ionice            = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_clear_size              = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_copy_bps_limit          = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_dd_blocksize            = 1M {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_name_template           = volume-%s {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_service_inithost_offload = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volume_usage_audit_period      = month {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] zoning_mode                    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_concurrency.disable_process_locking = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.admin_password = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.admin_token = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.admin_user  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_protocol = https {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_section = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_type   = password {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_uri    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.auth_version = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.cache       = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.certfile    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.identity_uri = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.include_service_catalog = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.insecure    = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.interface   = public {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.keyfile     = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_password =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcache_username =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.region_name = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.service_type = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.backend                  = dogpile.cache.null {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.backend_argument         = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.backend_expiration_time  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.config_prefix            = cache.oslo {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.debug_cache_backend      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.enable_retry_client      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.enable_socket_keepalive  = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.enabled                  = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.enforce_fips_mode        = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.expiration_time          = 600 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.hashclient_retry_attempts = 2 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.memcache_dead_retry      = 300 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.memcache_sasl_enabled    = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.password                 = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.proxies                  = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.redis_db                 = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.redis_server             = localhost:6379 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.retry_attempts           = 2 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.retry_delay              = 0.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.socket_keepalive_count   = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.socket_keepalive_idle    = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.socket_keepalive_interval = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.socket_timeout           = 1.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.tls_allowed_ciphers      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.tls_cafile               = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.tls_certfile             = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.tls_enabled              = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.tls_keyfile              = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cache.username                 = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] coordination.backend_url       = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.asyncio_connection    = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.asyncio_slave_connection = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.backend               = sqlalchemy {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.connection            = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.connection_debug      = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.connection_parameters =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.connection_recycle_time = 3600 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.connection_trace      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.db_inc_retry_interval = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.db_max_retries        = 20 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.db_max_retry_interval = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.db_retry_interval     = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.max_overflow          = 50 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.max_pool_size         = 5 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.max_retries           = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.mysql_wsrep_sync_wait = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.pool_timeout          = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.retry_interval        = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.slave_connection      = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.sqlite_synchronous    = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.synchronous_reader    = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] database.use_db_reconnect      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.connection_string     = messaging:// {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.enabled               = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.es_doc_type           = notification {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.es_scroll_size        = 10000 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.es_scroll_time        = 2m {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.filter_error_trace    = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack sudo[72491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 10 10:25:57 devstack sudo[72491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.hmac_keys             = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.sentinel_service_name = mymaster {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.socket_timeout        = 0.1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.trace_requests        = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler.trace_sqlalchemy      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler_jaeger.process_tags   = {} {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler_jaeger.service_name_prefix = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] profiler_otlp.service_name_prefix = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.enforce_new_defaults = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: WARNING oslo_config.cfg [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.enforce_scope      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.policy_default_rule = default {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] privsep_osbrick.group          = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] privsep_osbrick.helper_command = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] privsep_osbrick.user           = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_sys_admin.group         = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_sys_admin.helper_command = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] cinder_sys_admin.user          = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.auth_section      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.auth_type         = password {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.cafile            = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.certfile          = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.collect_timing    = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.insecure          = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.keyfile           = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.send_service_user_token = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.split_loggers     = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] service_user.timeout           = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.auth_section            = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.auth_type               = password {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.certfile                = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.collect_timing          = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.insecure                = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.keyfile                 = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.region_name             = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.split_loggers           = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] glance.timeout                 = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.backend_availability_zone = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.chap_password = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.chap_username =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.disk_geometry = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.driver_client_cert = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.driver_client_cert_key = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.driver_data_namespace = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.driver_use_ssl = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.extra_capabilities = {} {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.filter_function = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.goodness_function = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.iscsi_target_flags =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.iscsi_write_cache = on {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.iser_port     = 3260 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.lvm_share_target = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.lvm_type      = auto {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.num_shell_tries = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.replication_device = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.report_discard_supported = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.reserved_percentage = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.target_helper = tgtadm {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.target_port   = 3260 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.target_protocol = iscsi {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.trace_flags   = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.unique_fqdn_network = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.use_chap_auth = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_backend_name = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_clear  = zero {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_clear_ionice = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_clear_size = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_reports.file_event_handler = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_reports.log_dir           = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.backend_host       = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.chap_password      = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.chap_username      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.disk_geometry      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.driver_client_cert = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.extra_capabilities = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.filter_function    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.goodness_function  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.iser_helper        = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.iser_port          = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.lvm_type           = auto {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.replication_device = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.report_discard_supported = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.reserved_percentage = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.scst_target_driver = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.storage_protocol   = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.target_ip_address  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.target_port        = 3260 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.trace_flags        = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_clear       = zero {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] lvmdriver-1.volumes_dir        = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_notifications.driver = [] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_notifications.retry = -1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] key_manager.fixed_key          = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.barbican_api_version  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.barbican_endpoint     = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.barbican_endpoint_type = public {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.barbican_region_name  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.cafile                = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.certfile              = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.collect_timing        = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.insecure              = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.keyfile               = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.number_of_retries     = 60 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.retry_delay           = 1 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.send_service_user_token = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.split_loggers         = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.timeout               = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.verify_ssl            = True {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican.verify_ssl_path       = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.auth_section = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.auth_type = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.cafile   = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.certfile = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.collect_timing = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.insecure = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.keyfile  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.split_loggers = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] barbican_service_user.timeout  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.approle_role_id          = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.approle_secret_id        = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.kv_mountpoint            = secret {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.kv_path                  = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.kv_version               = 2 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.namespace                = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.root_token_id            = **** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.ssl_ca_crt_file          = None {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.timeout                  = 60.0 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.use_ssl                  = False {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:25:57 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] ******************************************************************************** {{(pid=72387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 10 10:25:57 devstack sudo[72491]: pam_unix(sudo:session): session closed for user root
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:57 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:57 devstack sudo[72494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:25:57 devstack sudo[72494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:25:58 devstack sudo[72494]: pam_unix(sudo:session): session closed for user root
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.583s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:25:58 devstack cinder-volume[72487]: INFO cinder.brick.local_dev.lvm [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:58 devstack sudo[72768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:25:58 devstack sudo[72768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:25:58 devstack sudo[72768]: pam_unix(sudo:session): session closed for user root
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG cinder.brick.local_dev.lvm [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72487) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 10 10:25:58 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:58 devstack sudo[72979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:25:58 devstack sudo[72979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:25:59 devstack sudo[72979]: pam_unix(sudo:session): session closed for user root
Apr 10 10:25:59 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.021s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:59 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:25:59 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:25:59 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:00 devstack sudo[73158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:26:00 devstack sudo[73158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:00 devstack sudo[73158]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:00 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:00 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:00 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:00 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:00 devstack sudo[73181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 10 10:26:00 devstack sudo[73181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:00 devstack sudo[73181]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:00 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.468s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:00 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:01 devstack sudo[73184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:26:01 devstack sudo[73184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:01 devstack sudo[73184]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:01 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:01 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:01 devstack sudo[73189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:26:01 devstack sudo[73189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:02 devstack sudo[73189]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:02 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:02 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:02 devstack sudo[73195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:26:02 devstack sudo[73195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:02 devstack sudo[73195]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:02 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:02 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:02 devstack sudo[73200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:26:02 devstack sudo[73200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:03 devstack sudo[73200]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:03 devstack sudo[73205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:26:03 devstack sudo[73205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:03 devstack sudo[73205]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.758s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:03 devstack cinder-volume[72487]: INFO cinder.volume.drivers.lvm [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:03 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:03 devstack sudo[73327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:26:03 devstack sudo[73327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:04 devstack sudo[73327]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:04 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:04 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 10:26:04 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:04 devstack sudo[73465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:26:04 devstack sudo[73465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:04 devstack sudo[73465]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:04 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:04 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:04 devstack sudo[73468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:26:04 devstack sudo[73468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:05 devstack sudo[73468]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:05 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:05 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:05 devstack sudo[73472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:26:05 devstack sudo[73472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:05 devstack sudo[73472]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:05 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:05 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:05 devstack sudo[73476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:26:05 devstack sudo[73476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:06 devstack sudo[73476]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:06 devstack cinder-volume[72487]: INFO cinder.volume.driver [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Driver hasn't implemented _init_vendor_properties()
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG cinder.volume.driver [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72487) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writer thread running {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG cinder.db.sqlalchemy.api [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Building query based on filter {{(pid=72487) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG cinder.image.image_utils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72487) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 10 10:26:06 devstack cinder-volume[72487]: INFO cinder.keymgr.migration [None req-4bc3b8b9-9124-490e-bc0a-cd2b6c976f4a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:06 devstack sudo[73483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:26:06 devstack sudo[73483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:06 devstack sudo[73483]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:06 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:06 devstack sudo[73487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:26:06 devstack sudo[73487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:06 devstack cinder-volume[72387]: DEBUG dbcounter [-] [72387] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72387) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:26:07 devstack sudo[73487]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:07 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.547s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:07 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:07 devstack sudo[73492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:26:07 devstack sudo[73492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:07 devstack sudo[73492]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:07 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.542s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:07 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:07 devstack sudo[73500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:26:08 devstack sudo[73500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:08 devstack sudo[73500]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG cinder.manager [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Notifying Schedulers of capabilities ... {{(pid=72487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:26:08 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Driver initialization completed successfully.
Apr 10 10:26:08 devstack cinder-volume[72487]: INFO cinder.manager [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Initiating service 2 cleanup
Apr 10 10:26:08 devstack cinder-volume[72487]: INFO cinder.manager [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Service 2 cleanup completed.
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG cinder.service [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Creating RPC server for service cinder-volume {{(pid=72487) start /opt/stack/cinder/cinder/service.py:231}}
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG cinder.service [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72487) start /opt/stack/cinder/cinder/service.py:237}}
Apr 10 10:26:08 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:08 devstack sudo[73557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:26:08 devstack sudo[73557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:08 devstack sudo[73557]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:08 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:08 devstack sudo[73560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:26:08 devstack sudo[73560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:09 devstack sudo[73560]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:09 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:09 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:09 devstack sudo[73564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:26:09 devstack sudo[73564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:09 devstack sudo[73564]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:09 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:09 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:26:09 devstack sudo[73583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:26:09 devstack sudo[73583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:26:10 devstack sudo[73583]: pam_unix(sudo:session): session closed for user root
Apr 10 10:26:10 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:26:10 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-e6a11a8a-b8b4-4038-994c-a232fb2402ca None None] Driver post RPC initialization completed successfully.
Apr 10 10:26:18 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writing DB stats cinder:SELECT=4 {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:26:20 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:27:36 devstack cinder-volume[72487]: DEBUG oslo_service.periodic_task [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72487) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:27:36 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 10:27:36 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:27:36 devstack sudo[78544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:27:36 devstack sudo[78544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:27:36 devstack sudo[78544]: pam_unix(sudo:session): session closed for user root
Apr 10 10:27:36 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:27:36 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:27:36 devstack sudo[78547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:27:36 devstack sudo[78547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:27:37 devstack sudo[78547]: pam_unix(sudo:session): session closed for user root
Apr 10 10:27:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:27:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:27:37 devstack sudo[78550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:27:37 devstack sudo[78550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:27:37 devstack sudo[78550]: pam_unix(sudo:session): session closed for user root
Apr 10 10:27:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:27:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:27:37 devstack sudo[78553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:27:37 devstack sudo[78553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:27:38 devstack sudo[78553]: pam_unix(sudo:session): session closed for user root
Apr 10 10:27:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:27:38 devstack cinder-volume[72487]: DEBUG cinder.manager [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Notifying Schedulers of capabilities ... {{(pid=72487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:28:20 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writing DB stats cinder:SELECT=1 {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:28:20 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writing DB stats cinder:UPDATE=1 {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:28:36 devstack cinder-volume[72487]: DEBUG oslo_service.periodic_task [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72487) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:28:36 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 10:28:36 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:28:36 devstack sudo[80424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 10:28:36 devstack sudo[80424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:28:36 devstack sudo[80424]: pam_unix(sudo:session): session closed for user root
Apr 10 10:28:36 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:28:36 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:28:36 devstack sudo[80427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:28:36 devstack sudo[80427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:28:37 devstack sudo[80427]: pam_unix(sudo:session): session closed for user root
Apr 10 10:28:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:28:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:28:37 devstack sudo[80430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 10:28:37 devstack sudo[80430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:28:37 devstack sudo[80430]: pam_unix(sudo:session): session closed for user root
Apr 10 10:28:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:28:37 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:28:37 devstack sudo[80449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 10:28:37 devstack sudo[80449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:28:38 devstack sudo[80449]: pam_unix(sudo:session): session closed for user root
Apr 10 10:28:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:28:38 devstack cinder-volume[72487]: DEBUG cinder.manager [None req-55e229c4-4405-47e8-b779-9e78f1bf586a None None] Notifying Schedulers of capabilities ... {{(pid=72487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:29:25 devstack cinder-volume[72387]: INFO oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Caught SIGTERM, stopping children
Apr 10 10:29:25 devstack cinder-volume[72387]: DEBUG oslo_concurrency.lockutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Acquiring lock "singleton_lock" {{(pid=72387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 10:29:25 devstack cinder-volume[72387]: DEBUG oslo_concurrency.lockutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Acquired lock "singleton_lock" {{(pid=72387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 10:29:25 devstack cinder-volume[72387]: DEBUG oslo_concurrency.lockutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Releasing lock "singleton_lock" {{(pid=72387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 10:29:25 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Stop services. {{(pid=72387) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 10 10:29:25 devstack cinder-volume[72387]: DEBUG oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Killing children. {{(pid=72387) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 10 10:29:25 devstack cinder-volume[72387]: INFO oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Waiting on 1 children to exit
Apr 10 10:29:28 devstack cinder-volume[72487]: DEBUG oslo_concurrency.lockutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Acquiring lock "singleton_lock" {{(pid=72487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 10:29:28 devstack cinder-volume[72487]: DEBUG oslo_concurrency.lockutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Acquired lock "singleton_lock" {{(pid=72487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 10:29:28 devstack cinder-volume[72487]: DEBUG oslo_concurrency.lockutils [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Releasing lock "singleton_lock" {{(pid=72487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 10:29:28 devstack cinder-volume[72487]: WARNING amqp [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 10:29:28 devstack cinder-volume[72487]: WARNING amqp [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 10:29:28 devstack cinder-volume[72387]: INFO oslo_service.backend._eventlet.service [None req-c39e0b88-8fcd-4c4d-b10f-dec69aaf89b9 None None] Child 72487 exited with status 0
Apr 10 10:29:28 devstack cinder-volume[81507]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 10 10:29:28 devstack cinder-volume[81507]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 10:29:28 devstack cinder-volume[81507]: we strongly recommend against using it for new projects.
Apr 10 10:29:28 devstack cinder-volume[81507]: If you are already using Eventlet, we recommend migrating to a different
Apr 10 10:29:28 devstack cinder-volume[81507]: framework.  For more detail see
Apr 10 10:29:28 devstack cinder-volume[81507]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 10:29:28 devstack cinder-volume[81507]:   import eventlet  # noqa
Apr 10 10:29:30 devstack cinder-volume[81507]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 10:29:30 devstack cinder-volume[81507]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 10:29:30 devstack cinder-volume[81507]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 10:29:31 devstack cinder-volume[81507]: INFO dbcounter [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Registered counter for database cinder
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG dbcounter [-] [81507] Writer thread running {{(pid=81507) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 10:29:31 devstack cinder-volume[81507]: INFO cinder.rpc [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 10 10:29:31 devstack cinder-volume[81507]: INFO cinder.rpc [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:31 devstack cinder-volume[81507]: INFO cinder.volume.manager [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Determined volume DB was empty at startup.
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG cinder.volume.manager [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81507) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 10 10:29:31 devstack cinder-volume[81507]: INFO cinder.volume.manager [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 10 10:29:31 devstack cinder-volume[81507]: WARNING stevedore.named [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 10:29:31 devstack cinder-volume[81507]: WARNING castellan.key_manager [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 10:29:31 devstack cinder-volume[81507]: WARNING cinder.keymgr.conf_key_mgr [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 10:29:31 devstack cinder-volume[81507]: INFO cinder.volume.manager [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:31 devstack cinder-volume[81507]: INFO oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Starting 1 workers
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Started child 81626 {{(pid=81507) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Full set of CONF: {{(pid=81507) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] ******************************************************************************** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Configuration options gathered from: {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] ================================================================================ {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 10 10:29:31 devstack cinder-volume[81626]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] allow_availability_zone_fallback = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] allow_compression_on_image_upload = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] allowed_direct_url_schemes     = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] api_rate_limit                 = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] auth_strategy                  = keystone {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_availability_zone      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_host                   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_name                   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_stats_polling_interval = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backup_api_class               = cinder.backup.api.API {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backup_name_template           = backup-%s {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backup_use_same_host           = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backup_use_temp_snapshot       = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] chap_password                  = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] chap_username                  =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_internal_tenant_project_id = 4439587e428a4e2d950864ee175af6d6 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_internal_tenant_user_id = d4859b7fc3af4b67aca303884ede3606 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cluster                        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] compression_format             = gzip {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] compute_api_class              = cinder.compute.nova.API {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] config_dir                     = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] config_source                  = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] control_exchange               = openstack {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] debug                          = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] default_availability_zone      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] default_group_type             = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] default_volume_type            = QuobyteHD {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] disk_geometry                  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] driver_client_cert             = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] driver_client_cert_key         = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] driver_data_namespace          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] driver_ssl_cert_path           = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] driver_ssl_cert_verify         = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] driver_use_ssl                 = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] enable_new_services            = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] enable_unsupported_driver      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] enabled_backends               = ['QuobyteHD'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] enforce_multipath_for_image_xfer = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] filter_function                = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_api_insecure            = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_api_servers             = ['http://192.168.122.164/image'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_api_ssl_compression     = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_ca_certificates_file    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_catalog_info            = image:glance:publicURL {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_certfile                = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_keyfile                 = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_num_retries             = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance_request_timeout         = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] goodness_function              = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] graceful_shutdown_timeout      = 5 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] group_api_class                = cinder.group.api.API {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] host                           = devstack {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_compress_on_upload       = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_conversion_address_space_limit = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_conversion_cpu_limit     = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_conversion_disable       = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_upload_use_cinder_backend = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_upload_use_internal_tenant = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_volume_cache_enabled     = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_volume_cache_max_count   = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] image_volume_cache_max_size_gb = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] init_host_max_objects_retrieval = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] instance_format                = [instance: %(uuid)s]  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] iscsi_target_flags             =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] iscsi_write_cache              = on {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] iser_helper                    = tgtadm {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] iser_ip_address                = 192.168.122.164 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] iser_port                      = 3260 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_color                      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_config_append              = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_dir                        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81626]: INFO cinder.volume.manager [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_file                       = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.remotefs [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81626) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_options                    = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_rotate_interval            = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_rotate_interval_type       = days {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] log_rotation_type              = none {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] max_age                        = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] max_logfile_count              = 30 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] max_logfile_size_mb            = 200 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] max_over_subscription_ratio    = 20.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] message_reap_interval          = 86400 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] message_ttl                    = 2592000 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] migration_create_volume_timeout_secs = 300 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] monkey_patch                   = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] monkey_patch_modules           = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] my_ip                          = 192.168.122.164 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] no_snapshot_gb_quota           = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] num_iser_scan_tries            = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] num_shell_tries                = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] num_volume_device_scan_tries   = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] nvmeof_conn_info_version       = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] nvmet_ns_id                    = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] nvmet_port_id                  = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] osapi_max_limit                = 1000 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] osapi_volume_ext_list          = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] osapi_volume_listen_port       = 8776 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] osapi_volume_use_ssl           = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] osapi_volume_workers           = 2 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] per_volume_size_limit          = -1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] periodic_fuzzy_delay           = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] periodic_interval              = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] public_endpoint                = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] publish_errors                 = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] quota_backup_gigabytes         = 1000 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] quota_backups                  = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] quota_gigabytes                = 1000 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] quota_groups                   = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] quota_snapshots                = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] quota_volumes                  = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] rate_limit_burst               = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] rate_limit_except_level        = CRITICAL {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] rate_limit_interval            = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] reinit_driver_count            = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] replication_device             = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] report_discard_supported       = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] report_interval                = 120 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] reservation_clean_interval     = 86400 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] reservation_expire             = 86400 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] reserved_image_namespaces      = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] reserved_percentage            = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] rpc_response_timeout           = 120 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] run_external_periodic_tasks    = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] scst_target_driver             = iscsi {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] scst_target_iqn_name           = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_down_time              = 720 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] shell_completion               = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] snapshot_name_template         = snapshot-%s {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] split_loggers                  = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] state_path                     = /opt/stack/data/cinder {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] storage_availability_zone      = nova {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] storage_protocol               = iSCSI {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] syslog_log_facility            = LOG_USER {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] target_helper                  = lioadm {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] target_ip_address              = 192.168.122.164 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] target_port                    = 3260 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] target_protocol                = iscsi {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] target_secondary_ip_addresses  = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] trace_flags                    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] transport_url                  = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] until_refresh                  = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] use_chap_auth                  = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] use_default_quota_class        = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] use_journal                    = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] use_json                       = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] use_multipath_for_image_xfer   = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] use_stderr                     = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] use_syslog                     = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] verify_glance_signatures       = enabled {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_api_class               = cinder.volume.api.API {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_backend_name            = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_clear                   = zero {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_clear_ionice            = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_clear_size              = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_copy_bps_limit          = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_dd_blocksize            = 1M {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_name_template           = volume-%s {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_service_inithost_offload = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volume_usage_audit_period      = month {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] zoning_mode                    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_concurrency.disable_process_locking = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.admin_password = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.admin_token = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.admin_user  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_port   = 35357 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_protocol = https {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_section = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_type   = password {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_uri    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.auth_version = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.cache       = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.certfile    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.identity_uri = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.include_service_catalog = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.insecure    = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.interface   = public {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.keyfile     = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_password =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcache_username =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.region_name = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.service_type = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.backend                  = dogpile.cache.null {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.backend_argument         = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.backend_expiration_time  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.config_prefix            = cache.oslo {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.debug_cache_backend      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.enable_retry_client      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.enable_socket_keepalive  = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.enabled                  = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.enforce_fips_mode        = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.expiration_time          = 600 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.hashclient_retry_attempts = 2 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.memcache_dead_retry      = 300 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.memcache_pool_maxsize    = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.memcache_sasl_enabled    = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.password                 = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.proxies                  = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81626) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.redis_db                 = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: WARNING cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 10 10:29:31 devstack cinder-volume[81626]: WARNING cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.redis_server             = localhost:6379 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.retry_attempts           = 2 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.retry_delay              = 0.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Running cmd (subprocess): mount.quobyte {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.socket_keepalive_count   = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.socket_keepalive_idle    = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.socket_keepalive_interval = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.socket_timeout           = 1.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.tls_allowed_ciphers      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.tls_cafile               = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.tls_certfile             = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.tls_enabled              = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.tls_keyfile              = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cache.username                 = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] coordination.backend_url       = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.asyncio_connection    = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.asyncio_slave_connection = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.backend               = sqlalchemy {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.connection            = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.connection_debug      = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.connection_parameters =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.connection_recycle_time = 3600 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.connection_trace      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.db_inc_retry_interval = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.db_max_retries        = 20 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.db_max_retry_interval = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.db_retry_interval     = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.max_overflow          = 50 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.max_pool_size         = 5 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.max_retries           = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.mysql_wsrep_sync_wait = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.pool_timeout          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.retry_interval        = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.slave_connection      = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.sqlite_synchronous    = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.synchronous_reader    = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] database.use_db_reconnect      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.connection_string     = messaging:// {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.enabled               = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.es_doc_type           = notification {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.es_scroll_size        = 10000 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.es_scroll_time        = 2m {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.filter_error_trace    = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.hmac_keys             = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.sentinel_service_name = mymaster {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.socket_timeout        = 0.1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.trace_requests        = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler.trace_sqlalchemy      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler_jaeger.process_tags   = {} {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler_jaeger.service_name_prefix = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] profiler_otlp.service_name_prefix = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.enforce_new_defaults = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: WARNING oslo_config.cfg [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.enforce_scope      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.policy_default_rule = default {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.policy_file        = policy.yaml {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] privsep_osbrick.group          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] privsep_osbrick.helper_command = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] privsep_osbrick.user           = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_sys_admin.group         = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_sys_admin.helper_command = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] cinder_sys_admin.user          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.auth_section      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.auth_type         = password {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.cafile            = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.certfile          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.collect_timing    = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.insecure          = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.keyfile           = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.send_service_user_token = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.split_loggers     = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] service_user.timeout           = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.auth_section            = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.auth_type               = password {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.certfile                = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.collect_timing          = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.insecure                = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.keyfile                 = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.region_name             = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.split_loggers           = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] glance.timeout                 = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.backend_availability_zone = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.chap_password = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.chap_username =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.disk_geometry = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.driver_client_cert = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.driver_client_cert_key = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.driver_data_namespace = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.driver_use_ssl = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.extra_capabilities = {} {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.filter_function = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.goodness_function = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.iscsi_target_flags =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.iscsi_write_cache = on {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.iser_helper   = tgtadm {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.iser_port     = 3260 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_host      =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_login     = admin {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_mount_options = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_password  = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_private_key =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_share_path =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.num_shell_tries = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.quobyte_client_cfg = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.quobyte_volume_url = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.replication_device = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.report_discard_supported = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.reserved_percentage = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.target_helper = tgtadm {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.target_port   = 3260 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.target_protocol = iscsi {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.trace_flags   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.unique_fqdn_network = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.use_chap_auth = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_backend_name = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_clear  = zero {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_clear_ionice = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_clear_size = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_reports.file_event_handler = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_reports.log_dir           = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.backend_availability_zone = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.backend_host         = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.chap_password        = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.chap_username        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.chiscsi_conf         = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.disk_geometry        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.driver_client_cert   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.driver_client_cert_key = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.driver_data_namespace = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.driver_use_ssl       = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.extra_capabilities   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.filter_function      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.goodness_function    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.iser_helper          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.iser_ip_address      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.iser_port            = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.iser_target_prefix   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_host             = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_login            = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_mount_options    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_password         = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_private_key      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_share_path       = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_ssh_port         = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.num_shell_tries      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.nvmet_port_id        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.replication_device   = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.report_discard_supported = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack quobyte-client[81627]: Reading configuration file: /etc/quobyte/client.cfg
Apr 10 10:29:31 devstack quobyte-client[81627]: Invalid parameters found, error: missing mount point.
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.reserved_percentage  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.scst_target_driver   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack quobyte-client[81627]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.storage_protocol     = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack quobyte-client[81627]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.target_helper        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.target_ip_address    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.target_port          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.target_prefix        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.target_protocol      = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.trace_flags          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.use_chap_auth        = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_clear         = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_clear_size    = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] QuobyteHD.volumes_dir          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.ssl      = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81626) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: INFO cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 ...
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_notifications.driver = [] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 -c /etc/quobyte/client-cinder.cfg {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_notifications.retry = -1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] key_manager.fixed_key          = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.barbican_api_version  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.barbican_endpoint     = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.barbican_endpoint_type = public {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.barbican_region_name  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.cafile                = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.certfile              = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.collect_timing        = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.insecure              = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.keyfile               = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.number_of_retries     = 60 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.retry_delay           = 1 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.send_service_user_token = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.split_loggers         = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.timeout               = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.verify_ssl            = True {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican.verify_ssl_path       = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.auth_section = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.auth_type = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.cafile   = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.certfile = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.collect_timing = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.insecure = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.keyfile  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.split_loggers = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] barbican_service_user.timeout  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.approle_role_id          = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.approle_secret_id        = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.kv_mountpoint            = secret {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.kv_path                  = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.kv_version               = 2 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.namespace                = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.root_token_id            = **** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.ssl_ca_crt_file          = None {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.timeout                  = 60.0 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.use_ssl                  = False {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:31 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] ******************************************************************************** {{(pid=81507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 10 10:29:31 devstack sudo[81628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 -c /etc/quobyte/client-cinder.cfg
Apr 10 10:29:31 devstack sudo[81628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:32 devstack sudo[81628]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.525s {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:32 devstack cinder-volume[81626]: INFO cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 succeeded
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81626) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.549s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:32 devstack sudo[81697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:29:32 devstack sudo[81697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:32 devstack sudo[81697]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.454s {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:32 devstack cinder-volume[81626]: INFO cinder.volume.driver [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Driver hasn't implemented _init_vendor_properties()
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG cinder.volume.driver [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81626) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_db.sqlalchemy.engines [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81626) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG dbcounter [-] [81626] Writer thread running {{(pid=81626) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG cinder.db.sqlalchemy.api [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Building query based on filter {{(pid=81626) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG cinder.image.image_utils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81626) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 10 10:29:32 devstack cinder-volume[81626]: INFO cinder.keymgr.migration [None req-63c5fefa-1970-4dd2-aa82-41919c36027a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81626) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81626) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:29:32 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:33 devstack sudo[81700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:29:33 devstack sudo[81700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:33 devstack sudo[81700]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.469s {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG cinder.manager [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Notifying Schedulers of capabilities ... {{(pid=81626) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:29:33 devstack cinder-volume[81626]: INFO cinder.volume.manager [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Driver initialization completed successfully.
Apr 10 10:29:33 devstack cinder-volume[81626]: INFO cinder.manager [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Initiating service 3 cleanup
Apr 10 10:29:33 devstack cinder-volume[81626]: INFO cinder.manager [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Service 3 cleanup completed.
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG cinder.service [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Creating RPC server for service cinder-volume {{(pid=81626) start /opt/stack/cinder/cinder/service.py:231}}
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG cinder.service [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81626) start /opt/stack/cinder/cinder/service.py:237}}
Apr 10 10:29:33 devstack cinder-volume[81626]: INFO cinder.volume.manager [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81626) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81626) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:29:33 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:33 devstack sudo[81705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:29:33 devstack sudo[81705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:34 devstack sudo[81705]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:34 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.435s {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:34 devstack cinder-volume[81626]: INFO cinder.volume.manager [None req-32dce2b6-dd4d-4eff-9f28-d1781d539d35 None None] Driver post RPC initialization completed successfully.
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81626) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG cinder.volume.drivers.quobyte [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81626) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81626) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:37 devstack sudo[81772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:29:37 devstack sudo[81772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:37 devstack sudo[81772]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG oslo_concurrency.processutils [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.421s {{(pid=81626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:37 devstack cinder-volume[81626]: DEBUG cinder.manager [None req-9a409293-5514-4a70-b1c3-27288948acbb None None] Notifying Schedulers of capabilities ... {{(pid=81626) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:29:40 devstack cinder-volume[81507]: INFO oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Caught SIGTERM, stopping children
Apr 10 10:29:40 devstack cinder-volume[81507]: DEBUG oslo_concurrency.lockutils [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Acquiring lock "singleton_lock" {{(pid=81507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 10:29:40 devstack cinder-volume[81507]: DEBUG oslo_concurrency.lockutils [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Acquired lock "singleton_lock" {{(pid=81507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 10:29:40 devstack cinder-volume[81507]: DEBUG oslo_concurrency.lockutils [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Releasing lock "singleton_lock" {{(pid=81507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 10:29:40 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Stop services. {{(pid=81507) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 10 10:29:40 devstack cinder-volume[81507]: DEBUG oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Killing children. {{(pid=81507) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 10 10:29:40 devstack cinder-volume[81507]: INFO oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Waiting on 1 children to exit
Apr 10 10:29:41 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Acquiring lock "singleton_lock" {{(pid=81626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 10:29:41 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Acquired lock "singleton_lock" {{(pid=81626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 10:29:41 devstack cinder-volume[81626]: DEBUG oslo_concurrency.lockutils [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Releasing lock "singleton_lock" {{(pid=81626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 10:29:41 devstack cinder-volume[81626]: WARNING amqp [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 10:29:41 devstack cinder-volume[81626]: WARNING amqp [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 10:29:41 devstack cinder-volume[81507]: INFO oslo_service.backend._eventlet.service [None req-4ba2e27a-5093-484c-b626-265cb6cdf43b None None] Child 81626 exited with status 0
Apr 10 10:29:42 devstack cinder-volume[81843]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 10 10:29:42 devstack cinder-volume[81843]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 10:29:42 devstack cinder-volume[81843]: we strongly recommend against using it for new projects.
Apr 10 10:29:42 devstack cinder-volume[81843]: If you are already using Eventlet, we recommend migrating to a different
Apr 10 10:29:42 devstack cinder-volume[81843]: framework.  For more detail see
Apr 10 10:29:42 devstack cinder-volume[81843]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 10:29:42 devstack cinder-volume[81843]:   import eventlet  # noqa
Apr 10 10:29:43 devstack cinder-volume[81843]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 10:29:43 devstack cinder-volume[81843]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 10:29:43 devstack cinder-volume[81843]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81843) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 10:29:44 devstack cinder-volume[81843]: INFO dbcounter [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Registered counter for database cinder
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_db.sqlalchemy.engines [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG dbcounter [-] [81843] Writer thread running {{(pid=81843) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 10:29:44 devstack cinder-volume[81843]: INFO cinder.rpc [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 10 10:29:44 devstack cinder-volume[81843]: INFO cinder.rpc [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_db.sqlalchemy.engines [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:44 devstack cinder-volume[81843]: INFO cinder.volume.manager [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Determined volume DB was empty at startup.
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG cinder.volume.manager [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81843) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 10 10:29:44 devstack cinder-volume[81843]: WARNING stevedore.named [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 10:29:44 devstack cinder-volume[81843]: WARNING castellan.key_manager [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 10:29:44 devstack cinder-volume[81843]: WARNING cinder.keymgr.conf_key_mgr [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 10:29:44 devstack cinder-volume[81843]: INFO cinder.volume.manager [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_db.sqlalchemy.engines [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:44 devstack cinder-volume[81843]: INFO oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Starting 1 workers
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Started child 81969 {{(pid=81843) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Full set of CONF: {{(pid=81843) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] ******************************************************************************** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Configuration options gathered from: {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] ================================================================================ {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] allow_availability_zone_fallback = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] allow_compression_on_image_upload = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] allowed_direct_url_schemes     = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] api_rate_limit                 = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] auth_strategy                  = keystone {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_availability_zone      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_host                   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_name                   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_stats_polling_interval = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backup_api_class               = cinder.backup.api.API {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backup_name_template           = backup-%s {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backup_use_same_host           = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backup_use_temp_snapshot       = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] chap_password                  = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] chap_username                  =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_internal_tenant_project_id = 4439587e428a4e2d950864ee175af6d6 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_internal_tenant_user_id = d4859b7fc3af4b67aca303884ede3606 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cluster                        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] compression_format             = gzip {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] compute_api_class              = cinder.compute.nova.API {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] config_dir                     = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] config_source                  = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] control_exchange               = openstack {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] debug                          = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] default_availability_zone      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] default_group_type             = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81969]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] default_volume_type            = QuobyteHD {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] disk_geometry                  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] driver_client_cert             = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] driver_client_cert_key         = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] driver_data_namespace          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] driver_ssl_cert_path           = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] driver_ssl_cert_verify         = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] driver_use_ssl                 = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] enable_new_services            = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] enable_unsupported_driver      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] enabled_backends               = ['QuobyteHD'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] enforce_multipath_for_image_xfer = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] filter_function                = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_api_insecure            = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_api_servers             = ['http://192.168.122.164/image'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_api_ssl_compression     = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_ca_certificates_file    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_catalog_info            = image:glance:publicURL {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_certfile                = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_keyfile                 = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_num_retries             = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance_request_timeout         = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] goodness_function              = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] graceful_shutdown_timeout      = 5 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] group_api_class                = cinder.group.api.API {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] host                           = devstack {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_compress_on_upload       = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_conversion_address_space_limit = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_conversion_cpu_limit     = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_conversion_disable       = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_upload_use_cinder_backend = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_upload_use_internal_tenant = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_volume_cache_enabled     = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_volume_cache_max_count   = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] image_volume_cache_max_size_gb = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] init_host_max_objects_retrieval = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] instance_format                = [instance: %(uuid)s]  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] iscsi_target_flags             =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] iscsi_write_cache              = on {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] iser_helper                    = tgtadm {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] iser_ip_address                = 192.168.122.164 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] iser_port                      = 3260 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_color                      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_config_append              = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_dir                        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_file                       = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_options                    = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_rotate_interval            = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_rotate_interval_type       = days {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] log_rotation_type              = none {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] max_age                        = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] max_logfile_count              = 30 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] max_logfile_size_mb            = 200 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] max_over_subscription_ratio    = 20.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] message_reap_interval          = 86400 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] message_ttl                    = 2592000 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] migration_create_volume_timeout_secs = 300 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] monkey_patch                   = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] monkey_patch_modules           = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] my_ip                          = 192.168.122.164 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] no_snapshot_gb_quota           = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] num_iser_scan_tries            = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] num_shell_tries                = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] num_volume_device_scan_tries   = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] nvmeof_conn_info_version       = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] nvmet_ns_id                    = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] nvmet_port_id                  = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] osapi_max_limit                = 1000 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] osapi_volume_ext_list          = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] osapi_volume_listen_port       = 8776 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] osapi_volume_use_ssl           = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] osapi_volume_workers           = 2 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] per_volume_size_limit          = -1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 10 10:29:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81969) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] periodic_fuzzy_delay           = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] periodic_interval              = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] public_endpoint                = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] publish_errors                 = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] quota_backup_gigabytes         = 1000 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] quota_backups                  = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] quota_gigabytes                = 1000 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] quota_groups                   = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] quota_snapshots                = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] quota_volumes                  = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] rate_limit_burst               = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] rate_limit_except_level        = CRITICAL {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] rate_limit_interval            = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] reinit_driver_count            = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] replication_device             = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] report_discard_supported       = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] report_interval                = 120 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] reservation_clean_interval     = 86400 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] reservation_expire             = 86400 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] reserved_image_namespaces      = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] reserved_percentage            = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] rpc_response_timeout           = 120 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] run_external_periodic_tasks    = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] scst_target_driver             = iscsi {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] scst_target_iqn_name           = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_down_time              = 720 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] shell_completion               = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] snapshot_name_template         = snapshot-%s {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] split_loggers                  = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] state_path                     = /opt/stack/data/cinder {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] storage_availability_zone      = nova {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] storage_protocol               = iSCSI {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] syslog_log_facility            = LOG_USER {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] target_helper                  = lioadm {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] target_ip_address              = 192.168.122.164 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] target_port                    = 3260 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] target_protocol                = iscsi {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] target_secondary_ip_addresses  = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] trace_flags                    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] transport_url                  = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] until_refresh                  = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] use_chap_auth                  = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] use_default_quota_class        = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] use_journal                    = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] use_json                       = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] use_multipath_for_image_xfer   = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] use_stderr                     = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] use_syslog                     = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] verify_glance_signatures       = enabled {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_api_class               = cinder.volume.api.API {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_backend_name            = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_clear                   = zero {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_clear_ionice            = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_clear_size              = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_copy_bps_limit          = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_dd_blocksize            = 1M {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_name_template           = volume-%s {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_service_inithost_offload = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volume_usage_audit_period      = month {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] zoning_mode                    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_concurrency.disable_process_locking = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.admin_password = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.admin_token = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.admin_user  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_port   = 35357 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_protocol = https {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_section = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_type   = password {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_uri    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.auth_version = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.cache       = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.certfile    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.delay_auth_decision = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.http_connect_timeout = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.identity_uri = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.include_service_catalog = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.insecure    = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.interface   = public {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.keyfile     = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_password =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcache_username =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.region_name = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.service_token_roles_required = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.service_type = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.token_cache_time = 300 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.backend                  = dogpile.cache.null {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.backend_argument         = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.backend_expiration_time  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.config_prefix            = cache.oslo {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.debug_cache_backend      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.enable_retry_client      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.enable_socket_keepalive  = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.enabled                  = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.enforce_fips_mode        = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.expiration_time          = 600 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.hashclient_retry_attempts = 2 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.memcache_dead_retry      = 300 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.memcache_pool_maxsize    = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.memcache_sasl_enabled    = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.password                 = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.proxies                  = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.redis_db                 = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.redis_sentinel_service_name = mymaster {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.redis_server             = localhost:6379 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.retry_attempts           = 2 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.retry_delay              = 0.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.socket_keepalive_count   = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.socket_keepalive_idle    = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.socket_keepalive_interval = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.socket_timeout           = 1.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.tls_allowed_ciphers      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81969) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 10 10:29:44 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.tls_cafile               = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.tls_certfile             = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.tls_enabled              = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.tls_keyfile              = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cache.username                 = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] coordination.backend_url       = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.asyncio_connection    = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.asyncio_slave_connection = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.backend               = sqlalchemy {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.connection            = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.connection_debug      = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Running cmd (subprocess): mount.quobyte {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.connection_parameters =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.connection_recycle_time = 3600 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.connection_trace      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.db_inc_retry_interval = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.db_max_retries        = 20 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.db_max_retry_interval = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.db_retry_interval     = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.max_overflow          = 50 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.max_pool_size         = 5 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.max_retries           = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.mysql_wsrep_sync_wait = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.pool_timeout          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.retry_interval        = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.slave_connection      = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.sqlite_synchronous    = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.synchronous_reader    = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] database.use_db_reconnect      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.connection_string     = messaging:// {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.enabled               = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.es_doc_type           = notification {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.es_scroll_size        = 10000 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.es_scroll_time        = 2m {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.filter_error_trace    = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.hmac_keys             = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.sentinel_service_name = mymaster {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.socket_timeout        = 0.1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.trace_requests        = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler.trace_sqlalchemy      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler_jaeger.process_tags   = {} {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler_jaeger.service_name_prefix = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] profiler_otlp.service_name_prefix = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.enforce_new_defaults = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: WARNING oslo_config.cfg [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.enforce_scope      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.policy_default_rule = default {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.policy_file        = policy.yaml {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] privsep_osbrick.group          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] privsep_osbrick.helper_command = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] privsep_osbrick.user           = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_sys_admin.group         = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_sys_admin.helper_command = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] cinder_sys_admin.user          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.auth_section      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.auth_type         = password {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.cafile            = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.certfile          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.collect_timing    = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.insecure          = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.keyfile           = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.send_service_user_token = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.split_loggers     = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] service_user.timeout           = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.auth_section            = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.auth_type               = password {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.certfile                = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.collect_timing          = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.insecure                = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.keyfile                 = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.region_name             = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.split_loggers           = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] glance.timeout                 = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.backend_availability_zone = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.chap_password = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.chap_username =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.disk_geometry = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.driver_client_cert = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.driver_client_cert_key = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.driver_data_namespace = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:44 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.driver_use_ssl = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.enable_unsupported_driver = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.extra_capabilities = {} {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.filter_function = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.goodness_function = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.iscsi_target_flags =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.iscsi_write_cache = on {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.iser_helper   = tgtadm {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.iser_port     = 3260 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_host      =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_login     = admin {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_mount_options = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_password  = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_private_key =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_share_path =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.num_shell_tries = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.nvmet_port_id = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.quobyte_client_cfg = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.quobyte_volume_url = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.replication_device = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.report_discard_supported = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.reserved_percentage = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.scst_target_driver = iscsi {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.scst_target_iqn_name = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.storage_protocol = iSCSI {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.target_helper = tgtadm {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.target_port   = 3260 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.target_protocol = iscsi {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.trace_flags   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.unique_fqdn_network = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.use_chap_auth = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_backend_name = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_clear  = zero {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_clear_ionice = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_clear_size = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack quobyte-client[81982]: Reading configuration file: /etc/quobyte/client.cfg
Apr 10 10:29:45 devstack quobyte-client[81982]: Invalid parameters found, error: missing mount point.
Apr 10 10:29:45 devstack quobyte-client[81982]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 10 10:29:45 devstack quobyte-client[81982]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_reports.file_event_handler = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_reports.log_dir           = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.backend_availability_zone = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.backend_host         = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.chap_password        = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.chap_username        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.chiscsi_conf         = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.disk_geometry        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.driver_client_cert   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.driver_client_cert_key = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.driver_data_namespace = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.driver_use_ssl       = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.extra_capabilities   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.filter_function      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.goodness_function    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] CMD "mount.quobyte" returned: 1 in 0.206s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.iser_helper          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.iser_ip_address      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.iser_port            = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.iser_target_prefix   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_host             = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_login            = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_mount_options    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_password         = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_private_key      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_share_path       = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_ssh_port         = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.num_shell_tries      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.nvmet_port_id        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.replication_device   = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.report_discard_supported = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.reserved_percentage  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.scst_target_driver   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.storage_protocol     = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.target_helper        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.target_ip_address    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.target_port          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.target_prefix        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.target_protocol      = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.trace_flags          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.use_chap_auth        = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_clear         = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_clear_size    = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack sudo[81983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack sudo[81983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] QuobyteHD.volumes_dir          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.ssl      = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_notifications.driver = [] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_notifications.retry = -1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] oslo_messaging_notifications.transport_url = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] key_manager.fixed_key          = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.barbican_api_version  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.barbican_endpoint     = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.barbican_endpoint_type = public {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.barbican_region_name  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.cafile                = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.certfile              = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.collect_timing        = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.insecure              = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.keyfile               = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.number_of_retries     = 60 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.retry_delay           = 1 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.send_service_user_token = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.split_loggers         = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.timeout               = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.verify_ssl            = True {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican.verify_ssl_path       = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.auth_section = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.auth_type = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.cafile   = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.certfile = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.collect_timing = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.insecure = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.keyfile  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.split_loggers = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] barbican_service_user.timeout  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.approle_role_id          = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.approle_secret_id        = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.kv_mountpoint            = secret {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.kv_path                  = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.kv_version               = 2 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.namespace                = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.root_token_id            = **** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.ssl_ca_crt_file          = None {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.timeout                  = 60.0 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.use_ssl                  = False {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 10:29:45 devstack cinder-volume[81843]: DEBUG oslo_service.backend._eventlet.service [None req-feb37ad7-c36c-4cd8-b0bc-80c7ce70bbbe None None] ******************************************************************************** {{(pid=81843) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 10 10:29:45 devstack sudo[81983]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.505s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:45 devstack cinder-volume[81969]: INFO cinder.volume.driver [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Driver hasn't implemented _init_vendor_properties()
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG cinder.volume.driver [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81969) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_db.sqlalchemy.engines [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writer thread running {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG cinder.db.sqlalchemy.api [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Building query based on filter {{(pid=81969) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81969) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:29:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:45 devstack cinder-volume[81969]: INFO cinder.keymgr.migration [None req-fde30a70-96af-4aa0-8275-42b463af6ecc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 10 10:29:45 devstack sudo[82035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:29:45 devstack sudo[82035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:46 devstack sudo[82035]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 1.059s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:29:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Driver initialization completed successfully.
Apr 10 10:29:46 devstack cinder-volume[81969]: INFO cinder.manager [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Initiating service 3 cleanup
Apr 10 10:29:46 devstack cinder-volume[81969]: INFO cinder.manager [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Service 3 cleanup completed.
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG cinder.service [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Creating RPC server for service cinder-volume {{(pid=81969) start /opt/stack/cinder/cinder/service.py:231}}
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG cinder.service [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81969) start /opt/stack/cinder/cinder/service.py:237}}
Apr 10 10:29:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:29:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:29:46 devstack sudo[82099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:29:46 devstack sudo[82099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:29:47 devstack sudo[82099]: pam_unix(sudo:session): session closed for user root
Apr 10 10:29:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.450s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:29:47 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7794a85e-b406-4741-ae54-6ae3358efc7c None None] Driver post RPC initialization completed successfully.
Apr 10 10:29:54 devstack cinder-volume[81843]: DEBUG dbcounter [-] [81843] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81843) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:29:56 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=2 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:29:57 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:31:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:31:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:31:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:31:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:37 devstack sudo[82646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:31:37 devstack sudo[82646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:38 devstack sudo[82646]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 1.268s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:38 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:31:41 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Flow 'volume_create_manager' (5b56c9d0-9365-4cd8-9471-14f72e2fec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec5cb74-4b65-4bcf-9fff-aae75b21e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec5cb74-4b65-4bcf-9fff-aae75b21e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-739722568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3db9fa-9567-41fc-aa22-44190abaa871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed2933d054341a6b6639a80a19ff124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:42Z,use_quota=True,user_id='ce9c8a4c4eb54653ba9a945a1a6f0f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153350ed-0f8e-4ae9-adfe-256932fddf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153350ed-0f8e-4ae9-adfe-256932fddf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db442686-9441-4503-a962-a44ac8c959ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db442686-9441-4503-a962-a44ac8c959ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3db9fa-9567-41fc-aa22-44190abaa871', 'volume_name': 'volume-6a3db9fa-9567-41fc-aa22-44190abaa871', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e37467-93e7-43e7-a7a2-9b30185d338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e37467-93e7-43e7-a7a2-9b30185d338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855a7582-a9cf-418f-a12d-c067b0f306a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:42 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Volume 6a3db9fa-9567-41fc-aa22-44190abaa871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3db9fa-9567-41fc-aa22-44190abaa871', 'volume_size': 1}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-739722568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3db9fa-9567-41fc-aa22-44190abaa871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed2933d054341a6b6639a80a19ff124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:42Z,use_quota=True,user_id='ce9c8a4c4eb54653ba9a945a1a6f0f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Creating volume 6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:31:42 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:42 devstack sudo[82678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 1073741824
Apr 10 10:31:42 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:42 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 1073741824" returned: 0 in 0.778s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:42 devstack sudo[82998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871
Apr 10 10:31:42 devstack sudo[82998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:43 devstack sudo[82998]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871" returned: 0 in 0.848s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:31:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855a7582-a9cf-418f-a12d-c067b0f306a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3db9fa-9567-41fc-aa22-44190abaa871', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05c1369-1498-478d-830c-d45f46678b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:43 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Volume volume-6a3db9fa-9567-41fc-aa22-44190abaa871 (6a3db9fa-9567-41fc-aa22-44190abaa871): created successfully
Apr 10 10:31:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05c1369-1498-478d-830c-d45f46678b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Flow 'volume_create_manager' (5b56c9d0-9365-4cd8-9471-14f72e2fec89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:43 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-da027102-3824-4c87-a759-1e1a718de6fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Created volume successfully.
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Flow 'volume_create_manager' (e206dfd9-3e09-4c9f-85eb-eaeb26ebe972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b75c98-e316-4df7-bd84-99beb3f71b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b75c98-e316-4df7-bd84-99beb3f71b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-364451982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91988632-983a-4533-ad8d-d991bb5e121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbba82aee044a3c96493d8bf66a4d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:45Z,use_quota=True,user_id='14a80e01d45344e590698e24d51ee61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673fcb27-f720-49f7-a1a7-693ded5e2ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673fcb27-f720-49f7-a1a7-693ded5e2ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e18842-3664-4fdd-a7d9-a260607730d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e18842-3664-4fdd-a7d9-a260607730d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91988632-983a-4533-ad8d-d991bb5e121d', 'volume_name': 'volume-91988632-983a-4533-ad8d-d991bb5e121d', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0bfdc1-86a6-400a-ace3-b61d5c06e36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0bfdc1-86a6-400a-ace3-b61d5c06e36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da051dc-c4bb-4e79-af94-3544c659f439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:45 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Volume 91988632-983a-4533-ad8d-d991bb5e121d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91988632-983a-4533-ad8d-d991bb5e121d', 'volume_size': 1}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-364451982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91988632-983a-4533-ad8d-d991bb5e121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbba82aee044a3c96493d8bf66a4d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:45Z,use_quota=True,user_id='14a80e01d45344e590698e24d51ee61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Creating volume 91988632-983a-4533-ad8d-d991bb5e121d {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:31:45 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:45 devstack sudo[83012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d 1073741824
Apr 10 10:31:45 devstack sudo[83012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:46 devstack sudo[83012]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d 1073741824" returned: 0 in 1.165s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:46 devstack sudo[83018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d
Apr 10 10:31:46 devstack sudo[83018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:48 devstack sudo[83018]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d" returned: 0 in 1.306s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] <== create_volume: return (2516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.442s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da051dc-c4bb-4e79-af94-3544c659f439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91988632-983a-4533-ad8d-d991bb5e121d', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd5b394-2eb9-456f-82c5-e81d5efe3a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Creating offline snapshot 7aff406a-4508-43d4-9a3a-db214e5171ec of volume 6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:31:48 devstack cinder-volume[81969]: INFO oslo.privsep.daemon [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdjkloc28/privsep.sock']
Apr 10 10:31:48 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Volume volume-91988632-983a-4533-ad8d-d991bb5e121d (91988632-983a-4533-ad8d-d991bb5e121d): created successfully
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd5b394-2eb9-456f-82c5-e81d5efe3a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Flow 'volume_create_manager' (e206dfd9-3e09-4c9f-85eb-eaeb26ebe972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:48 devstack sudo[83022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdjkloc28/privsep.sock
Apr 10 10:31:48 devstack sudo[83022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5d30afc7-5256-4276-8394-7865ef8b93a7 tempest-ServersNegativeTestJSON-801468501 None] Created volume successfully.
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Flow 'volume_create_manager' (764abebb-8ad2-4704-9064-88feb62ae49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d458915-28fc-4afe-b8b6-3e0a2f0db8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d458915-28fc-4afe-b8b6-3e0a2f0db8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:48Z,deleted=False,deleted_at=None,display_description='',display_name='c425cce3-add9-4431-aacd-423980c5d7ac-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d1427d-86f8-4717-8fd7-dc007d3ed41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b99a0c9e18a4710b9488006452fa5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:49Z,use_quota=True,user_id='1ffbb757ec3a420ab6688f1c2f2a9748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc89ed82-0f3e-47d2-8fcb-d3e98ebdf11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc89ed82-0f3e-47d2-8fcb-d3e98ebdf11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d2e831-9c65-4690-90b8-7e9f4e76cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d2e831-9c65-4690-90b8-7e9f4e76cb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d1427d-86f8-4717-8fd7-dc007d3ed41c', 'volume_name': 'volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4c7ab7-ba58-45c2-af42-d0c4f9e10a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4c7ab7-ba58-45c2-af42-d0c4f9e10a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258ff214-fc3e-431b-acb3-3bd664aa83c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:48 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Volume 87d1427d-86f8-4717-8fd7-dc007d3ed41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c', 'volume_size': 1}
Apr 10 10:31:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 10:31:49 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 10:31:50 devstack cinder-volume[81969]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 10 10:31:51 devstack sudo[83022]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:51 devstack cinder-volume[81969]: INFO oslo.privsep.daemon [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Spawned new privsep daemon via rootwrap
Apr 10 10:31:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Accepted privsep connection to /tmp/tmpdjkloc28/privsep.sock {{(pid=81969) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 10 10:31:51 devstack cinder-volume[81969]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 10 10:31:51 devstack cinder-volume[81969]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 10 10:31:51 devstack cinder-volume[81969]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 10 10:31:51 devstack cinder-volume[81969]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83053
Apr 10 10:31:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2ef7f6-9abd-4085-8e7b-d219b9f343d6]: (2,) {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:31:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[49508716-0726-4b3a-8d26-daa6a8616416]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:31:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:51 devstack sudo[83055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871
Apr 10 10:31:51 devstack sudo[83055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Flow 'volume_create_manager' (332972ee-2367-4053-92b2-724c2197c350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1a0590-bbd3-4ea0-be9d-d992a8df5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1a0590-bbd3-4ea0-be9d-d992a8df5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1640881313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbba82aee044a3c96493d8bf66a4d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:52Z,use_quota=True,user_id='14a80e01d45344e590698e24d51ee61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88cc176-e590-4676-964a-e8db2cb4481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88cc176-e590-4676-964a-e8db2cb4481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbcddaf-7a35-4c20-8088-f8b8fe223f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbcddaf-7a35-4c20-8088-f8b8fe223f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612', 'volume_name': 'volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969e66cc-9c4d-4a97-8317-0e7ddab31340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969e66cc-9c4d-4a97-8317-0e7ddab31340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eca416-cb52-4d7a-b009-b319586715fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:52 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Volume bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612', 'volume_size': 1}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:52 devstack sudo[83055]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871" returned: 0 in 1.182s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:52 devstack sudo[83088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec 1G
Apr 10 10:31:52 devstack sudo[83088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:53 devstack sudo[83088]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec 1G" returned: 0 in 1.321s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a3db9fa-9567-41fc-aa22-44190abaa871 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:54 devstack sudo[83095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a3db9fa-9567-41fc-aa22-44190abaa871 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec
Apr 10 10:31:54 devstack sudo[83095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:54 devstack sudo[83095]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a3db9fa-9567-41fc-aa22-44190abaa871 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec" returned: 0 in 0.559s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:54 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec is being set with open permissions: ugo+rw
Apr 10 10:31:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:54 devstack sudo[83100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec
Apr 10 10:31:54 devstack sudo[83100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:55 devstack sudo[83100]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec" returned: 0 in 0.640s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:55 devstack sudo[83137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.info
Apr 10 10:31:55 devstack sudo[83137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:55 devstack sudo[83137]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.info" returned: 0 in 0.554s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:55 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.info is being set with open permissions: ugo+rw
Apr 10 10:31:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:55 devstack sudo[83140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.info
Apr 10 10:31:55 devstack sudo[83140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:56 devstack sudo[83140]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.info" returned: 0 in 0.607s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.173s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.692s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:48Z,deleted=False,deleted_at=None,display_description='',display_name='c425cce3-add9-4431-aacd-423980c5d7ac-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d1427d-86f8-4717-8fd7-dc007d3ed41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b99a0c9e18a4710b9488006452fa5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:49Z,use_quota=True,user_id='1ffbb757ec3a420ab6688f1c2f2a9748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Creating volume 87d1427d-86f8-4717-8fd7-dc007d3ed41c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:31:56 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:31:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-2eaf77b7-3c81-4f38-ae23-4930ed51b438 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Create snapshot completed successfully
Apr 10 10:31:56 devstack sudo[83143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c 1073741824
Apr 10 10:31:56 devstack sudo[83143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:57 devstack sudo[83143]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c 1073741824" returned: 0 in 0.631s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:57 devstack sudo[83148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c
Apr 10 10:31:57 devstack sudo[83148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "cinder-7aff406a-4508-43d4-9a3a-db214e5171ec-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:31:57 devstack sudo[83148]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-7aff406a-4508-43d4-9a3a-db214e5171ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "cinder-quobyte-6a3db9fa-9567-41fc-aa22-44190abaa871" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c" returned: 0 in 0.719s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-quobyte-6a3db9fa-9567-41fc-aa22-44190abaa871" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "cinder-quobyte-7aff406a-4508-43d4-9a3a-db214e5171ec" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.623s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1640881313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbba82aee044a3c96493d8bf66a4d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:52Z,use_quota=True,user_id='14a80e01d45344e590698e24d51ee61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Creating volume bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:31:57 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-quobyte-7aff406a-4508-43d4-9a3a-db214e5171ec" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Deleting offline snapshot 7aff406a-4508-43d4-9a3a-db214e5171ec of volume 6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:31:57 devstack sudo[83151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 1073741824
Apr 10 10:31:57 devstack sudo[83151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] snapshot_file for this snap is: volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258ff214-fc3e-431b-acb3-3bd664aa83c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996c2a1f-cb5f-47d1-b016-4317ad279132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:58 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Volume volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c (87d1427d-86f8-4717-8fd7-dc007d3ed41c): created successfully
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996c2a1f-cb5f-47d1-b016-4317ad279132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Flow 'volume_create_manager' (764abebb-8ad2-4704-9064-88feb62ae49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6597e795-66d2-4fb2-a9dc-07e1ae4f34e7]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:58 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-acb5bf9d-de93-41e8-98a5-a4fb1bd2f4cf tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Created volume successfully.
Apr 10 10:31:58 devstack sudo[83153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec
Apr 10 10:31:58 devstack sudo[83153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:58 devstack sudo[83151]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 1073741824" returned: 0 in 0.863s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:58 devstack sudo[83153]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec" returned: 0 in 0.737s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a3db9fa-9567-41fc-aa22-44190abaa871(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d3aba0-54f5-4260-b64c-3970d6701752]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:31:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:58 devstack sudo[83162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612
Apr 10 10:31:58 devstack sudo[83162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:58 devstack sudo[83163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871
Apr 10 10:31:58 devstack sudo[83163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:31:59 devstack sudo[83162]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612" returned: 0 in 0.834s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eca416-cb52-4d7a-b009-b319586715fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03231436-b932-4ae5-9d13-34a084c0ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:31:59 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Volume volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 (bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612): created successfully
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03231436-b932-4ae5-9d13-34a084c0ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Flow 'volume_create_manager' (332972ee-2367-4053-92b2-724c2197c350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:31:59 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e4fa0434-2a49-4feb-b456-741cc6c4f021 tempest-ServersNegativeTestJSON-801468501 None] Created volume successfully.
Apr 10 10:31:59 devstack sudo[83163]: pam_unix(sudo:session): session closed for user root
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871" returned: 0 in 1.105s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:31:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:31:59 devstack sudo[83171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec
Apr 10 10:31:59 devstack sudo[83171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:00 devstack sudo[83171]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec" returned: 0 in 0.702s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:00 devstack sudo[83176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec
Apr 10 10:32:00 devstack sudo[83176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "cinder-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "cinder-quobyte-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-quobyte-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612" acquired by "delete_volume" :: waited 0.036s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77258f-4dc0-4180-b2e4-bf290672a04a]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:01 devstack sudo[83178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612
Apr 10 10:32:01 devstack sudo[83178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:01 devstack sudo[83176]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871.7aff406a-4508-43d4-9a3a-db214e5171ec" returned: 0 in 0.686s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-quobyte-7aff406a-4508-43d4-9a3a-db214e5171ec" released by "_delete_snapshot" :: held 3.417s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-quobyte-6a3db9fa-9567-41fc-aa22-44190abaa871" released by "delete_snapshot" :: held 3.473s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:01 devstack cinder-volume[81969]: WARNING cinder.quota [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:32:01 devstack cinder-volume[81969]: WARNING cinder.quota [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Created reservations ['91193a10-4164-4440-b271-cc2a22aae93e', '4d57f869-3123-4fe5-a8f0-6682dea38102', '032e8317-8ffb-4238-804c-e773dad34dd8', '943b04bf-c846-406f-b997-6de9bffc8b66'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:01 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Delete snapshot completed successfully.
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2d3ea211-2148-46b2-897e-632cc89b3304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-7aff406a-4508-43d4-9a3a-db214e5171ec-delete_snapshot" released by "delete_snapshot" :: held 3.945s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:01 devstack sudo[83178]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612" returned: 0 in 0.754s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:01 devstack sudo[83186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612
Apr 10 10:32:01 devstack sudo[83186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "cinder-6a3db9fa-9567-41fc-aa22-44190abaa871-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-6a3db9fa-9567-41fc-aa22-44190abaa871-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "cinder-quobyte-6a3db9fa-9567-41fc-aa22-44190abaa871" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-quobyte-6a3db9fa-9567-41fc-aa22-44190abaa871" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[294dd0d3-eefa-4ad7-b852-dd7de2d28d9b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:02 devstack sudo[83186]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612" returned: 0 in 0.763s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:02 devstack sudo[83190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871
Apr 10 10:32:02 devstack sudo[83190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-quobyte-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612" released by "delete_volume" :: held 1.579s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:02 devstack cinder-volume[81969]: WARNING cinder.quota [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Created reservations ['c86c259f-4f17-4e65-8a86-23eec26828fb', '30cb9bbd-75ed-48a4-b4d7-20780d04db5e', '81759038-4bd7-42cd-bf24-fa1dca7023e6', '51335508-40a2-4d1d-b917-001cb3b8b3d2'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:02 devstack sudo[83193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:02 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:03 devstack sudo[83190]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871" returned: 0 in 0.789s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:03 devstack sudo[83198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871
Apr 10 10:32:03 devstack sudo[83198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "cinder-91988632-983a-4533-ad8d-d991bb5e121d-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-91988632-983a-4533-ad8d-d991bb5e121d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "cinder-quobyte-91988632-983a-4533-ad8d-d991bb5e121d" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-quobyte-91988632-983a-4533-ad8d-d991bb5e121d" acquired by "delete_volume" :: waited 0.038s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[36036ff7-32de-4b72-a48a-7c8c9eed7a4c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:03 devstack sudo[83201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d
Apr 10 10:32:03 devstack sudo[83201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:03 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 1.016s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:03 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Deleted volume successfully.
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82eb2153-c2fb-47c5-a66d-f1e4c40a5872 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-bf8e0ae1-1ec3-42b9-abdb-a8258bd4b612-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:04 devstack cinder-volume[81969]: WARNING py.warnings [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 10 10:32:04 devstack cinder-volume[81969]:   .first()
Apr 10 10:32:04 devstack cinder-volume[81969]: 
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42a5b7d-36f2-4d0e-a6e7-4d76d53bf6f7]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:04 devstack sudo[83198]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a3db9fa-9567-41fc-aa22-44190abaa871" returned: 0 in 1.159s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-quobyte-6a3db9fa-9567-41fc-aa22-44190abaa871" released by "delete_volume" :: held 2.014s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:04 devstack sudo[83214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c
Apr 10 10:32:04 devstack sudo[83214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Created reservations ['d6c7ae59-e30d-4e92-a8f9-f5d0308a796b', '6ee39698-b191-47c3-960d-3ed2982ae0ae', 'ceb11187-df5b-44c5-aff5-65d4f717566c', 'f4a6174a-a56d-42db-afab-50af3658f5cc'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:04 devstack sudo[83219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:04 devstack sudo[83219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:04 devstack sudo[83201]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d" returned: 0 in 1.364s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:04 devstack sudo[83221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d
Apr 10 10:32:04 devstack sudo[83221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:05 devstack sudo[83214]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c" returned: 0 in 1.069s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.105s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98', 'name': 'volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cdd5578-9096-4a60-bb32-eef2b20332ae', 'enforce_multipath': True} {{(pid=81969) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 10 10:32:05 devstack sudo[83219]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.899s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:05 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Deleted volume successfully.
Apr 10 10:32:05 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-dc71ef4d-3c56-4c45-9aff-0b414fe80227 req-80a79703-8f3b-4872-bd9e-ed86a671877c tempest-ServerBootFromVolumeStableRescueTest-147161644 None] attachment_update completed successfully.
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-814bda5e-8c48-4ceb-96f9-c28404ae0d07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1335821969 None] Lock "cinder-6a3db9fa-9567-41fc-aa22-44190abaa871-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:05 devstack sudo[83221]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-91988632-983a-4533-ad8d-d991bb5e121d" returned: 0 in 0.779s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-quobyte-91988632-983a-4533-ad8d-d991bb5e121d" released by "delete_volume" :: held 2.189s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Created reservations ['220907da-0cd5-4475-b973-46efcf29a539', '36d83d7a-b47a-4c81-8c92-5ee093421cb5', '96f372f4-1c0a-448d-b120-83c5e7c75378', '36c8d009-b157-4dec-ab24-606d96ee9e3a'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:05 devstack sudo[83228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:05 devstack sudo[83228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:06 devstack sudo[83228]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.539s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:06 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:06 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Deleted volume successfully.
Apr 10 10:32:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a519f4d1-057e-4fc9-b2bf-ef737b7e1c95 tempest-ServersNegativeTestJSON-801468501 None] Lock "cinder-91988632-983a-4533-ad8d-d991bb5e121d-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:15 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=42,cinder:UPDATE=41,cinder:INSERT=12,cinder:DELETE=6 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Flow 'volume_create_manager' (fddebc13-3ada-418e-8b33-ebed38f3cc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aeac461-139e-4542-bb4b-129bbde575db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aeac461-139e-4542-bb4b-129bbde575db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1071353236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e260b7e-4c8a-4990-a88b-134f940bacb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14f0b73bae24caea41f533ceb5de0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:16Z,use_quota=True,user_id='5154c3738d7a4a3483c26f84d80ca3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56b8f0d-b069-4cd2-aa64-9ff612259b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56b8f0d-b069-4cd2-aa64-9ff612259b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f8a59-442e-4194-8e64-58a143bce2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.image.glance [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Creating Keystone auth plugin from conf {{(pid=81969) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f8a59-442e-4194-8e64-58a143bce2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e260b7e-4c8a-4990-a88b-134f940bacb5', 'volume_name': 'volume-3e260b7e-4c8a-4990-a88b-134f940bacb5', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78e23784f0>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47c25d4-10ab-4fb1-b4d3-db7843451373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47c25d4-10ab-4fb1-b4d3-db7843451373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d974775e-c6b4-4b24-aa9d-8f1b54785955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:16 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Volume 3e260b7e-4c8a-4990-a88b-134f940bacb5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e260b7e-4c8a-4990-a88b-134f940bacb5', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78e23784f0>}
Apr 10 10:32:16 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Trying to clone 3e260b7e-4c8a-4990-a88b-134f940bacb5 from image 2fe75249-df95-461c-a1b7-506809038618 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]). {{(pid=81969) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (beafa750-c0e9-4708-96e4-b36050bf2b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445d9862-b4b9-43b3-97b7-40bd9633668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445d9862-b4b9-43b3-97b7-40bd9633668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315329886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8866f325-2178-4eff-ab81-0f70af8729f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:17Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f574f7-fbe1-465b-b321-4d334f9041f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f574f7-fbe1-465b-b321-4d334f9041f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab1692a-f717-4b28-a608-bcbac43373a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab1692a-f717-4b28-a608-bcbac43373a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8866f325-2178-4eff-ab81-0f70af8729f5', 'volume_name': 'volume-8866f325-2178-4eff-ab81-0f70af8729f5', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099d7619-d52a-45d7-b06d-3f9230e4a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099d7619-d52a-45d7-b06d-3f9230e4a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195ee5ba-ec66-4ed8-9819-45359c425929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Volume 8866f325-2178-4eff-ab81-0f70af8729f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8866f325-2178-4eff-ab81-0f70af8729f5', 'volume_size': 1}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315329886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8866f325-2178-4eff-ab81-0f70af8729f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:17Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Creating volume 8866f325-2178-4eff-ab81-0f70af8729f5 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:17 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:17 devstack sudo[83727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5 1073741824
Apr 10 10:32:17 devstack sudo[83727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 10:32:17 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9184d79-9cbf-4ae5-a8be-da1fea5d25d5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:17 devstack sudo[83729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD
Apr 10 10:32:17 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:18 devstack sudo[83727]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5 1073741824" returned: 0 in 0.905s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:18 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:18 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 is fetched for user 5154c3738d7a4a3483c26f84d80ca3bd. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 10:32:18 devstack sudo[83737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5
Apr 10 10:32:18 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:18 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ce261a-4226-400d-ba8a-cf12cb26502c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:18 devstack sudo[83739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD
Apr 10 10:32:18 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:19 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:19 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5" returned: 0 in 0.778s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.035s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1071353236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e260b7e-4c8a-4990-a88b-134f940bacb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14f0b73bae24caea41f533ceb5de0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:16Z,use_quota=True,user_id='5154c3738d7a4a3483c26f84d80ca3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Creating volume 3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:19 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195ee5ba-ec66-4ed8-9819-45359c425929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8866f325-2178-4eff-ab81-0f70af8729f5', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717880cc-6b79-445d-9832-51ad47939874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:19 devstack sudo[83745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 1073741824
Apr 10 10:32:19 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:19 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Volume volume-8866f325-2178-4eff-ab81-0f70af8729f5 (8866f325-2178-4eff-ab81-0f70af8729f5): created successfully
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717880cc-6b79-445d-9832-51ad47939874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (beafa750-c0e9-4708-96e4-b36050bf2b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5dccc727-7a1e-4491-afbc-578da5ddb638 tempest-VolumesActionsTest-724539666 None] Created volume successfully.
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5f32b97c-2320-4363-b2e5-ebc747f43b93 tempest-VolumesActionsTest-724539666 None] Acquiring lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5" by "attach_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5f32b97c-2320-4363-b2e5-ebc747f43b93 tempest-VolumesActionsTest-724539666 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5" acquired by "attach_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5f32b97c-2320-4363-b2e5-ebc747f43b93 tempest-VolumesActionsTest-724539666 None] Attaching volume 8866f325-2178-4eff-ab81-0f70af8729f5 to instance 8931daa9-f67e-4cea-9ead-776306b5ba52 at mountpoint /dev/vdb on host None.
Apr 10 10:32:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5f32b97c-2320-4363-b2e5-ebc747f43b93 tempest-VolumesActionsTest-724539666 None] Attach volume completed successfully.
Apr 10 10:32:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5f32b97c-2320-4363-b2e5-ebc747f43b93 tempest-VolumesActionsTest-724539666 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5" released by "attach_volume" :: held 0.269s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:20 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 1073741824" returned: 0 in 1.070s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:20 devstack sudo[83752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5
Apr 10 10:32:20 devstack sudo[83752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:20 devstack sudo[83752]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5" returned: 0 in 0.529s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Attempting download of 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume 3e260b7e-4c8a-4990-a88b-134f940bacb5. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 10:32:20 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ec134740-4620-4c47-8525-850455b3df0f tempest-VolumesActionsTest-354795973 None] Terminate volume connection completed successfully.
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2f685e-0874-4e0b-bc08-fd01a58289f7]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_309s0qz9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:20 devstack sudo[83755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_309s0qz9
Apr 10 10:32:20 devstack sudo[83755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec134740-4620-4c47-8525-850455b3df0f tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-detach_volume" by "detach_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec134740-4620-4c47-8525-850455b3df0f tempest-VolumesActionsTest-354795973 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ec134740-4620-4c47-8525-850455b3df0f tempest-VolumesActionsTest-354795973 None] Detaching volume 8866f325-2178-4eff-ab81-0f70af8729f5 from instance 8931daa9-f67e-4cea-9ead-776306b5ba52.
Apr 10 10:32:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ec134740-4620-4c47-8525-850455b3df0f tempest-VolumesActionsTest-354795973 None] Detach volume completed successfully.
Apr 10 10:32:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec134740-4620-4c47-8525-850455b3df0f tempest-VolumesActionsTest-354795973 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:21 devstack sudo[83755]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_309s0qz9" returned: 0 in 0.598s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_309s0qz9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:21 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_309s0qz9
Apr 10 10:32:21 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:22 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_309s0qz9" returned: 1 in 0.630s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_309s0qz9' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[138e1751-1c57-43b2-a2c8-ed01cdc86d08]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05f2ed97-8549-4a15-8cd5-e292cfbb3839 tempest-VolumesActionsTest-724539666 None] Acquiring lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-detach_volume" by "detach_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05f2ed97-8549-4a15-8cd5-e292cfbb3839 tempest-VolumesActionsTest-724539666 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:22 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-05f2ed97-8549-4a15-8cd5-e292cfbb3839 tempest-VolumesActionsTest-724539666 None] Volume detach called, but volume not attached.
Apr 10 10:32:22 devstack sudo[83783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD
Apr 10 10:32:22 devstack sudo[83783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05f2ed97-8549-4a15-8cd5-e292cfbb3839 tempest-VolumesActionsTest-724539666 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Flow 'volume_create_manager' (2ab7046e-5ee9-4364-8588-d2ff3bf123e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0267fd98-7f8b-420e-a4ce-f2c09f42e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0267fd98-7f8b-420e-a4ce-f2c09f42e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-695693863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e20e876-4d29-44db-b53c-e68777387545,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c958dde1da24d0192039c00f7d614b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:22Z,use_quota=True,user_id='b9e1eed0cc3745d591c86c18437e0c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7ea084-991b-4001-a7d3-3829ff6ac9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7ea084-991b-4001-a7d3-3829ff6ac9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a04be99-3a18-41bb-959b-4cfad0f0a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a04be99-3a18-41bb-959b-4cfad0f0a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e20e876-4d29-44db-b53c-e68777387545', 'volume_name': 'volume-0e20e876-4d29-44db-b53c-e68777387545', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac7020f-13ec-420d-bab9-cd5d679f0ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac7020f-13ec-420d-bab9-cd5d679f0ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80200f2e-eaf1-46ef-8862-8f727c03463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:22 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Volume 0e20e876-4d29-44db-b53c-e68777387545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e20e876-4d29-44db-b53c-e68777387545', 'volume_size': 1}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-695693863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e20e876-4d29-44db-b53c-e68777387545,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c958dde1da24d0192039c00f7d614b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:22Z,use_quota=True,user_id='b9e1eed0cc3745d591c86c18437e0c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Creating volume 0e20e876-4d29-44db-b53c-e68777387545 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:22 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:22 devstack sudo[83786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545 1073741824
Apr 10 10:32:22 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Acquiring lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Acquiring lock "cinder-quobyte-8866f325-2178-4eff-ab81-0f70af8729f5" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Lock "cinder-quobyte-8866f325-2178-4eff-ab81-0f70af8729f5" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12e8378-a62d-4c7d-bc56-e894d0165aea]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:22 devstack sudo[83783]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] 2fe75249-df95-461c-a1b7-506809038618 was qcow2, converting to raw {{(pid=81969) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 10:32:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:22 devstack sudo[83795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5
Apr 10 10:32:22 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:22 devstack sudo[83792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5
Apr 10 10:32:23 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:23 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545 1073741824" returned: 0 in 0.677s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:23 devstack sudo[83799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545
Apr 10 10:32:23 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:23 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5" returned: 0 in 0.884s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:23 devstack sudo[83811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5
Apr 10 10:32:23 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:23 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545" returned: 0 in 0.663s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80200f2e-eaf1-46ef-8862-8f727c03463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e20e876-4d29-44db-b53c-e68777387545', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4303c3ed-f2ee-4c34-91e3-646bb28864ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:23 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Volume volume-0e20e876-4d29-44db-b53c-e68777387545 (0e20e876-4d29-44db-b53c-e68777387545): created successfully
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4303c3ed-f2ee-4c34-91e3-646bb28864ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Flow 'volume_create_manager' (2ab7046e-5ee9-4364-8588-d2ff3bf123e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:23 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f402d4c8-079b-4548-a1e8-3cb7ed4b2e23 tempest-VolumesTestJSON-707332136 None] Created volume successfully.
Apr 10 10:32:24 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8866f325-2178-4eff-ab81-0f70af8729f5" returned: 0 in 0.630s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Lock "cinder-quobyte-8866f325-2178-4eff-ab81-0f70af8729f5" released by "delete_volume" :: held 1.551s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Created reservations ['dae3e674-43fa-4192-9d00-2b5f2d54686e', 'b025a631-d3e3-4d22-a0df-fb8adf390206', 'a1ff9306-5920-4430-b895-9b5fd926c901', 'd223a1fe-8666-42fb-abb4-c9b76daecd89'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:24 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5" returned: 0 in 1.637s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_kqzc7tendevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:32:24 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Converted 112.00 MB image at 68.38 MB/s
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:24 devstack sudo[83834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 1G
Apr 10 10:32:24 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:24 devstack sudo[83835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:24 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Flow 'volume_create_manager' (08333722-3433-41ec-95e8-b1e647a3563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36184872-5e51-4ded-8ee3-be663a185fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36184872-5e51-4ded-8ee3-be663a185fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1470412084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f4759b-d9f9-4d48-a203-363c99e240bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c958dde1da24d0192039c00f7d614b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:25Z,use_quota=True,user_id='b9e1eed0cc3745d591c86c18437e0c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd1959-ec6b-4ccf-95f3-ca6801c5380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd1959-ec6b-4ccf-95f3-ca6801c5380e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d548e58-d716-432a-ad64-28bc049e00c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d548e58-d716-432a-ad64-28bc049e00c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f4759b-d9f9-4d48-a203-363c99e240bd', 'volume_name': 'volume-25f4759b-d9f9-4d48-a203-363c99e240bd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b244b-1a4e-46f3-a085-e96b7dae0026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b244b-1a4e-46f3-a085-e96b7dae0026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32c88e2-92a8-4a4d-8c9c-7a0dede62f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:25 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Volume 25f4759b-d9f9-4d48-a203-363c99e240bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f4759b-d9f9-4d48-a203-363c99e240bd', 'volume_size': 1}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1470412084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f4759b-d9f9-4d48-a203-363c99e240bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c958dde1da24d0192039c00f7d614b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:25Z,use_quota=True,user_id='b9e1eed0cc3745d591c86c18437e0c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Creating volume 25f4759b-d9f9-4d48-a203-363c99e240bd {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:25 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:25 devstack sudo[83841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd 1073741824
Apr 10 10:32:25 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:25 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.645s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:25 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Deleted volume successfully.
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e5b3ab9-f082-4c91-a6a4-61585d08a160 tempest-VolumesActionsTest-724539666 None] Lock "cinder-8866f325-2178-4eff-ab81-0f70af8729f5-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:25 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 1G" returned: 0 in 0.832s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be38df1-cf58-479b-a9cb-a4dbfa451802]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:25 devstack sudo[83846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5
Apr 10 10:32:25 devstack sudo[83846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:25 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd 1073741824" returned: 0 in 0.675s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:25 devstack sudo[83851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd
Apr 10 10:32:25 devstack sudo[83851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:26 devstack sudo[83846]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5" returned: 0 in 0.670s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:26 devstack sudo[83855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5
Apr 10 10:32:26 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:26 devstack sudo[83851]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd" returned: 0 in 0.638s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32c88e2-92a8-4a4d-8c9c-7a0dede62f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f4759b-d9f9-4d48-a203-363c99e240bd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca7dee0-7d92-4c1d-8de6-a60c9970c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:26 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Volume volume-25f4759b-d9f9-4d48-a203-363c99e240bd (25f4759b-d9f9-4d48-a203-363c99e240bd): created successfully
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca7dee0-7d92-4c1d-8de6-a60c9970c68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Flow 'volume_create_manager' (08333722-3433-41ec-95e8-b1e647a3563a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:26 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-26c7884c-1358-4ce2-b3da-98e684d480fa tempest-VolumesTestJSON-707332136 None] Created volume successfully.
Apr 10 10:32:26 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5" returned: 1 in 0.786s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Downloaded image 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume 3e260b7e-4c8a-4990-a88b-134f940bacb5 successfully. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 for user 5154c3738d7a4a3483c26f84d80ca3bd is deleted. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Marking volume 3e260b7e-4c8a-4990-a88b-134f940bacb5 as bootable. {{(pid=81969) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Copying metadata from image 2fe75249-df95-461c-a1b7-506809038618 to 3e260b7e-4c8a-4990-a88b-134f940bacb5. {{(pid=81969) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Creating volume glance metadata for volume 3e260b7e-4c8a-4990-a88b-134f940bacb5 backed by image 2fe75249-df95-461c-a1b7-506809038618 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81969) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d974775e-c6b4-4b24-aa9d-8f1b54785955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e260b7e-4c8a-4990-a88b-134f940bacb5', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78e23784f0>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f17f34-63f5-49c3-a16a-02a988efa80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:26 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Volume volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 (3e260b7e-4c8a-4990-a88b-134f940bacb5): created successfully
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f17f34-63f5-49c3-a16a-02a988efa80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Flow 'volume_create_manager' (fddebc13-3ada-418e-8b33-ebed38f3cc57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:26 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a5924ec3-c153-4350-aa2c-1e3b99a5cc7f tempest-VolumesImageMetadata-361097646 None] Created volume successfully.
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Flow 'volume_create_manager' (2fde943a-7a25-44a9-bc28-6b640713f066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a36bb3-189b-496f-a141-27a2153f90b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a36bb3-189b-496f-a141-27a2153f90b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1103531935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4e3f22-bb03-45cd-8829-60f8dff99ef3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c958dde1da24d0192039c00f7d614b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:28Z,use_quota=True,user_id='b9e1eed0cc3745d591c86c18437e0c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951c1767-b05f-4c9f-8879-7e4c25c1efc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951c1767-b05f-4c9f-8879-7e4c25c1efc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bde5beb-69df-4fa8-b0c0-a288728e1c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bde5beb-69df-4fa8-b0c0-a288728e1c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4e3f22-bb03-45cd-8829-60f8dff99ef3', 'volume_name': 'volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab97b84-eed0-4dfd-a0ba-44ea1aaf155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab97b84-eed0-4dfd-a0ba-44ea1aaf155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71e8862-ebc1-4a90-ba44-94cb3a6df615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:27 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Volume ae4e3f22-bb03-45cd-8829-60f8dff99ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3', 'volume_size': 1}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1103531935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4e3f22-bb03-45cd-8829-60f8dff99ef3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c958dde1da24d0192039c00f7d614b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:28Z,use_quota=True,user_id='b9e1eed0cc3745d591c86c18437e0c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Creating volume ae4e3f22-bb03-45cd-8829-60f8dff99ef3 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:27 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:27 devstack sudo[83896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3 1073741824
Apr 10 10:32:27 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Acquiring lock "cinder-3e260b7e-4c8a-4990-a88b-134f940bacb5-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Lock "cinder-3e260b7e-4c8a-4990-a88b-134f940bacb5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Acquiring lock "cinder-quobyte-3e260b7e-4c8a-4990-a88b-134f940bacb5" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Lock "cinder-quobyte-3e260b7e-4c8a-4990-a88b-134f940bacb5" acquired by "delete_volume" :: waited 0.025s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f36060d-5bab-4db5-b7d8-db7080d37348]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:27 devstack sudo[83922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5
Apr 10 10:32:27 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:28 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3 1073741824" returned: 0 in 0.666s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:28 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5" returned: 0 in 0.624s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:28 devstack sudo[83946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3
Apr 10 10:32:28 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:28 devstack sudo[83948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5
Apr 10 10:32:28 devstack sudo[83948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:29 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3" returned: 0 in 0.863s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71e8862-ebc1-4a90-ba44-94cb3a6df615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebfb64a-773f-40ec-8d35-320a24c223a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:29 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Volume volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3 (ae4e3f22-bb03-45cd-8829-60f8dff99ef3): created successfully
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebfb64a-773f-40ec-8d35-320a24c223a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Flow 'volume_create_manager' (2fde943a-7a25-44a9-bc28-6b640713f066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-dc1d9a47-1ba5-4ff0-a88a-ad0c897bd019 tempest-VolumesTestJSON-707332136 None] Created volume successfully.
Apr 10 10:32:29 devstack sudo[83948]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5" returned: 1 in 1.071s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:32:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:29 devstack sudo[83964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5
Apr 10 10:32:29 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:30 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3e260b7e-4c8a-4990-a88b-134f940bacb5" returned: 0 in 0.701s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Lock "cinder-quobyte-3e260b7e-4c8a-4990-a88b-134f940bacb5" released by "delete_volume" :: held 2.468s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Created reservations ['6d013cd0-6007-43e8-9b82-c95190c44b25', '1c6e3801-cf72-4eb8-90c7-831dd18dd56f', 'f6cb3820-ddf6-4e39-ab19-cc656d06c69d', '24018ed8-ba9b-4466-8300-17b1d56db374'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:30 devstack sudo[83967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:30 devstack sudo[83967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Acquiring lock "cinder-ae4e3f22-bb03-45cd-8829-60f8dff99ef3-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Lock "cinder-ae4e3f22-bb03-45cd-8829-60f8dff99ef3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Acquiring lock "cinder-quobyte-ae4e3f22-bb03-45cd-8829-60f8dff99ef3" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Lock "cinder-quobyte-ae4e3f22-bb03-45cd-8829-60f8dff99ef3" acquired by "delete_volume" :: waited 0.018s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[186671eb-0538-48a8-ab39-de6a7334316d]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:30 devstack sudo[83969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3
Apr 10 10:32:30 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:30 devstack sudo[83967]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.634s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:30 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Deleted volume successfully.
Apr 10 10:32:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-436de73b-34f2-4565-9bdd-c481ff3ad3c2 tempest-VolumesImageMetadata-361097646 None] Lock "cinder-3e260b7e-4c8a-4990-a88b-134f940bacb5-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:31 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3" returned: 0 in 0.636s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:31 devstack sudo[83975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3
Apr 10 10:32:31 devstack sudo[83975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:31 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (9a0b7084-c5b2-4602-878c-72c43446d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8be0cf-c2cc-48e7-bcad-c29a07c42e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8be0cf-c2cc-48e7-bcad-c29a07c42e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-203822634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd349e5-d03e-4764-8fcc-eebd0c959456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:32Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5964b86-83ac-46ca-9fa0-e92f2c20474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5964b86-83ac-46ca-9fa0-e92f2c20474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2ee459-4234-40a9-8432-a32cde206d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2ee459-4234-40a9-8432-a32cde206d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd349e5-d03e-4764-8fcc-eebd0c959456', 'volume_name': 'volume-4bd349e5-d03e-4764-8fcc-eebd0c959456', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75a1c7a-5156-45f0-a4f3-da415ff665b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75a1c7a-5156-45f0-a4f3-da415ff665b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee437ba-b391-4654-8939-cba92c97e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:32 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Volume 4bd349e5-d03e-4764-8fcc-eebd0c959456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd349e5-d03e-4764-8fcc-eebd0c959456', 'volume_size': 1}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-203822634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd349e5-d03e-4764-8fcc-eebd0c959456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:32Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Creating volume 4bd349e5-d03e-4764-8fcc-eebd0c959456 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:32 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:32 devstack sudo[83978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456 1073741824
Apr 10 10:32:32 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:32 devstack sudo[83975]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ae4e3f22-bb03-45cd-8829-60f8dff99ef3" returned: 0 in 0.712s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Lock "cinder-quobyte-ae4e3f22-bb03-45cd-8829-60f8dff99ef3" released by "delete_volume" :: held 1.390s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Created reservations ['a29f7b94-6070-457d-85d1-683db3a4f884', '539ddc29-b4a5-455e-a04a-38b069c4ac4f', '9a2dd4e9-2753-4cc2-8e1f-8a90f279c50f', '66dcb73f-b548-4846-b63e-5f9182bd37d9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:32 devstack sudo[83980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:32 devstack sudo[83980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:32 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456 1073741824" returned: 0 in 0.845s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:33 devstack sudo[83986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456
Apr 10 10:32:33 devstack sudo[83986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:33 devstack sudo[83980]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Acquiring lock "cinder-25f4759b-d9f9-4d48-a203-363c99e240bd-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.655s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Lock "cinder-25f4759b-d9f9-4d48-a203-363c99e240bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Acquiring lock "cinder-quobyte-25f4759b-d9f9-4d48-a203-363c99e240bd" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Lock "cinder-quobyte-25f4759b-d9f9-4d48-a203-363c99e240bd" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:33 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Deleted volume successfully.
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eeba66-3378-438e-932f-6749d2ec1d26]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3ccb2f28-2cb0-494f-b7da-647387e9491d tempest-VolumesTestJSON-707332136 None] Lock "cinder-ae4e3f22-bb03-45cd-8829-60f8dff99ef3-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:33 devstack sudo[83988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd
Apr 10 10:32:33 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:33 devstack sudo[83986]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456" returned: 0 in 0.709s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee437ba-b391-4654-8939-cba92c97e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd349e5-d03e-4764-8fcc-eebd0c959456', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a7bcf9-3e44-4e99-9fbf-45a2431c8af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:33 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Volume volume-4bd349e5-d03e-4764-8fcc-eebd0c959456 (4bd349e5-d03e-4764-8fcc-eebd0c959456): created successfully
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a7bcf9-3e44-4e99-9fbf-45a2431c8af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (9a0b7084-c5b2-4602-878c-72c43446d60a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:33 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-44d6f6f2-d195-4cb1-b0a6-53893edc1550 tempest-VolumesActionsTest-724539666 None] Created volume successfully.
Apr 10 10:32:33 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd" returned: 0 in 0.746s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:33 devstack sudo[84018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd
Apr 10 10:32:33 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-4bd349e5-d03e-4764-8fcc-eebd0c959456-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Lock "cinder-4bd349e5-d03e-4764-8fcc-eebd0c959456-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:34 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25f4759b-d9f9-4d48-a203-363c99e240bd" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-quobyte-4bd349e5-d03e-4764-8fcc-eebd0c959456" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Lock "cinder-quobyte-25f4759b-d9f9-4d48-a203-363c99e240bd" released by "delete_volume" :: held 1.359s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-4bd349e5-d03e-4764-8fcc-eebd0c959456" acquired by "delete_volume" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2b7fda-12b4-4b93-947f-8f0b8f1321bb]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:34 devstack sudo[84041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456
Apr 10 10:32:34 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Flow 'volume_create_manager' (6a7e39f9-680d-4734-a6df-d0b1757782f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ad8ed3-e804-4471-b48e-cdafc458ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ad8ed3-e804-4471-b48e-cdafc458ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1077581266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511efbd8-7936-4981-9199-173d296b5149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dd5058f3aa4bf58c3ca9d8b3028fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:35Z,use_quota=True,user_id='d33386e071ad4c238e72aac4460774ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d5b1ed-f0e9-4910-9513-7e9c2d77edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d5b1ed-f0e9-4910-9513-7e9c2d77edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c770870-344b-497b-8415-4c15562a0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c770870-344b-497b-8415-4c15562a0eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511efbd8-7936-4981-9199-173d296b5149', 'volume_name': 'volume-511efbd8-7936-4981-9199-173d296b5149', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaede70-e1d3-4277-896a-64937fdc5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaede70-e1d3-4277-896a-64937fdc5500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c608d2a2-4865-46bc-834d-2019cb13e527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Volume 511efbd8-7936-4981-9199-173d296b5149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511efbd8-7936-4981-9199-173d296b5149', 'volume_size': 1}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1077581266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511efbd8-7936-4981-9199-173d296b5149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dd5058f3aa4bf58c3ca9d8b3028fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:35Z,use_quota=True,user_id='d33386e071ad4c238e72aac4460774ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Creating volume 511efbd8-7936-4981-9199-173d296b5149 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:34 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Created reservations ['f29db3e9-0002-4531-ac6c-e7e2960cf266', '1041c9c7-7435-4b63-9811-5e91910d5b6f', '6f55e693-3e0c-488f-95e0-43b38bfe9009', '9b689a8d-0da0-4130-9288-33c9a75a9d95'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:34 devstack sudo[84045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149 1073741824
Apr 10 10:32:34 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:34 devstack sudo[84047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:34 devstack sudo[84047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:35 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456" returned: 0 in 0.779s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:35 devstack sudo[84053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456
Apr 10 10:32:35 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Acquiring lock "cinder-0e20e876-4d29-44db-b53c-e68777387545-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Lock "cinder-0e20e876-4d29-44db-b53c-e68777387545-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Acquiring lock "cinder-quobyte-0e20e876-4d29-44db-b53c-e68777387545" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Lock "cinder-quobyte-0e20e876-4d29-44db-b53c-e68777387545" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e399fcc-0bf3-46cf-a555-fa46a23fed25]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:35 devstack sudo[84058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545
Apr 10 10:32:35 devstack sudo[84058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:35 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149 1073741824" returned: 0 in 0.900s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:35 devstack sudo[84047]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.788s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:35 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Deleted volume successfully.
Apr 10 10:32:35 devstack sudo[84061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149
Apr 10 10:32:35 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-077c5878-fb08-45f9-aa81-f8a9acf4d2a8 tempest-VolumesTestJSON-707332136 None] Lock "cinder-25f4759b-d9f9-4d48-a203-363c99e240bd-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:35 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bd349e5-d03e-4764-8fcc-eebd0c959456" returned: 0 in 0.553s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-4bd349e5-d03e-4764-8fcc-eebd0c959456" released by "delete_volume" :: held 1.362s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Created reservations ['1b86c2f3-86b0-44e4-a6b1-2fbd7297b965', '785c6ca0-4d36-4dbd-9660-d083d010d9c6', '6dd43e0d-f10c-4bfe-9a93-c94bca0ab2ef', '9e08c920-e8c6-42e0-928f-c0e98ec4a4f2'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:35 devstack sudo[84064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:35 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:36 devstack sudo[84058]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545" returned: 0 in 0.649s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:36 devstack sudo[84070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545
Apr 10 10:32:36 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:36 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149" returned: 0 in 0.468s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c608d2a2-4865-46bc-834d-2019cb13e527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511efbd8-7936-4981-9199-173d296b5149', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c8b6c4-36be-4a40-bffa-0823569bab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:36 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Volume volume-511efbd8-7936-4981-9199-173d296b5149 (511efbd8-7936-4981-9199-173d296b5149): created successfully
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c8b6c4-36be-4a40-bffa-0823569bab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Flow 'volume_create_manager' (6a7e39f9-680d-4734-a6df-d0b1757782f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-904a1943-a5c1-40ee-911e-857dd52530e3 tempest-AbsoluteLimitsTests-927482901 None] Created volume successfully.
Apr 10 10:32:36 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.542s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Deleted volume successfully.
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-581707e6-aa17-4aa7-9c7e-8ca731bd37d6 tempest-VolumesActionsTest-354795973 None] Lock "cinder-4bd349e5-d03e-4764-8fcc-eebd0c959456-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:36 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0e20e876-4d29-44db-b53c-e68777387545" returned: 0 in 0.559s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Lock "cinder-quobyte-0e20e876-4d29-44db-b53c-e68777387545" released by "delete_volume" :: held 1.237s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Created reservations ['402c78bf-87d3-4dba-891d-e8753db249da', '0ccf8a14-50b2-47c8-b633-db3703e56480', '43e40930-a380-4da2-90b9-1816b90d9d8c', '187fa123-0b5b-432a-8f36-4966864f7d0c'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:36 devstack sudo[84074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:36 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Acquiring lock "cinder-511efbd8-7936-4981-9199-173d296b5149-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Lock "cinder-511efbd8-7936-4981-9199-173d296b5149-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Acquiring lock "cinder-quobyte-511efbd8-7936-4981-9199-173d296b5149" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Lock "cinder-quobyte-511efbd8-7936-4981-9199-173d296b5149" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[45664d62-397a-4edf-a233-af49220dd8f0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:37 devstack sudo[84076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149
Apr 10 10:32:37 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (5b742a63-0270-4d17-94a6-e4b53b5b69e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe599d83-fa36-4160-84d3-298d4a9e2506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe599d83-fa36-4160-84d3-298d4a9e2506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722683897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a813332-e60a-476e-958f-cde15a887ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:37Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38108b8e-deab-4ad8-9aa6-4b8df8625e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38108b8e-deab-4ad8-9aa6-4b8df8625e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc4251-672b-4ff4-ac83-eca7aa00c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc4251-672b-4ff4-ac83-eca7aa00c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a813332-e60a-476e-958f-cde15a887ad9', 'volume_name': 'volume-0a813332-e60a-476e-958f-cde15a887ad9', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787b8b89-c731-49f8-8d19-5d4d25464186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787b8b89-c731-49f8-8d19-5d4d25464186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916a0526-7875-4e0c-879d-e6fafd021f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:37 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Volume 0a813332-e60a-476e-958f-cde15a887ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a813332-e60a-476e-958f-cde15a887ad9', 'volume_size': 1}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722683897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a813332-e60a-476e-958f-cde15a887ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:37Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Creating volume 0a813332-e60a-476e-958f-cde15a887ad9 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:37 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:37 devstack sudo[84078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9 1073741824
Apr 10 10:32:37 devstack sudo[84078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:37 devstack sudo[84081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:37 devstack sudo[84081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:37 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.768s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:37 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Deleted volume successfully.
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=110,cinder:UPDATE=125,cinder:DELETE=8,cinder:INSERT=38 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-bc2bac35-6aaa-4b21-a839-2da532930124 tempest-VolumesTestJSON-707332136 None] Lock "cinder-0e20e876-4d29-44db-b53c-e68777387545-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:37 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149" returned: 0 in 0.799s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:37 devstack sudo[84089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149
Apr 10 10:32:37 devstack sudo[84089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:37 devstack sudo[84078]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9 1073741824" returned: 0 in 0.676s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:37 devstack sudo[84091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9
Apr 10 10:32:37 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:38 devstack sudo[84081]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.658s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:38 devstack sudo[84089]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-511efbd8-7936-4981-9199-173d296b5149" returned: 0 in 0.580s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Lock "cinder-quobyte-511efbd8-7936-4981-9199-173d296b5149" released by "delete_volume" :: held 1.427s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Created reservations ['d9eaa7c0-a033-474a-9e28-99ecb70da9f1', '3e7a4114-450e-4593-8dbb-596b15a5b2a0', 'cbd0f056-8204-4dab-8d00-f09d74dafa06', 'abdd54ac-2f0d-47a4-bb56-2026b5191ea2'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:38 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9" returned: 0 in 0.600s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916a0526-7875-4e0c-879d-e6fafd021f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a813332-e60a-476e-958f-cde15a887ad9', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2898d-ef87-4206-860e-8ff16692e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:38 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Volume volume-0a813332-e60a-476e-958f-cde15a887ad9 (0a813332-e60a-476e-958f-cde15a887ad9): created successfully
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2898d-ef87-4206-860e-8ff16692e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (5b742a63-0270-4d17-94a6-e4b53b5b69e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:38 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-55c6b0cc-d498-4e8d-be93-e29821c87ca4 tempest-VolumesActionsTest-724539666 None] Created volume successfully.
Apr 10 10:32:38 devstack sudo[84096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:38 devstack sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:39 devstack sudo[84096]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.565s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:39 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Deleted volume successfully.
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-56812e0f-2554-4c17-94c1-85cce54c63a1 tempest-AbsoluteLimitsTests-927482901 None] Lock "cinder-511efbd8-7936-4981-9199-173d296b5149-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-0a813332-e60a-476e-958f-cde15a887ad9-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Lock "cinder-0a813332-e60a-476e-958f-cde15a887ad9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-quobyte-0a813332-e60a-476e-958f-cde15a887ad9" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-0a813332-e60a-476e-958f-cde15a887ad9" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93fe336-1d94-48ba-bebc-3a0b4cf7cbaa]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:39 devstack sudo[84100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9
Apr 10 10:32:39 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:40 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9" returned: 0 in 0.704s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:40 devstack sudo[84105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9
Apr 10 10:32:40 devstack sudo[84105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:40 devstack sudo[84105]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-0a813332-e60a-476e-958f-cde15a887ad9" returned: 0 in 0.551s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-0a813332-e60a-476e-958f-cde15a887ad9" released by "delete_volume" :: held 1.295s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Created reservations ['7acaa2ea-e3e5-4adf-87a0-f244eac570fa', '25348d27-363e-4b70-b265-0cd0669ae54e', '7b2eaad2-6c47-42ae-b69b-c7ee045e4d5f', '83f3c938-02fc-46bb-8542-f3b409968401'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:40 devstack sudo[84108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:40 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:41 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.530s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:41 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:41 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Deleted volume successfully.
Apr 10 10:32:41 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4561a03c-bf20-4e68-8491-ca4828a0f871 tempest-VolumesActionsTest-354795973 None] Lock "cinder-0a813332-e60a-476e-958f-cde15a887ad9-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (a851542b-a20f-4dcd-872c-cc745d76ead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e70696-ca6f-4b40-aab9-79aaf45829a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e70696-ca6f-4b40-aab9-79aaf45829a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-32986314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6a9812-9788-4a47-931b-9da816237d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:42Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5ca5ac-dc91-4bbe-8bc5-e88c6748b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5ca5ac-dc91-4bbe-8bc5-e88c6748b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d825f02d-ae92-47ed-b4fb-f11d42aa36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d825f02d-ae92-47ed-b4fb-f11d42aa36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6a9812-9788-4a47-931b-9da816237d63', 'volume_name': 'volume-7b6a9812-9788-4a47-931b-9da816237d63', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2317da-4d97-4da0-9092-5c60c9020fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2317da-4d97-4da0-9092-5c60c9020fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7244a4ec-ef92-4db7-b3e8-131798524f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:42 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Volume 7b6a9812-9788-4a47-931b-9da816237d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6a9812-9788-4a47-931b-9da816237d63', 'volume_size': 1}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-32986314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6a9812-9788-4a47-931b-9da816237d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:42Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Creating volume 7b6a9812-9788-4a47-931b-9da816237d63 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:42 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:42 devstack sudo[84111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63 1073741824
Apr 10 10:32:42 devstack sudo[84111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:42 devstack sudo[84111]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63 1073741824" returned: 0 in 0.735s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:42 devstack sudo[84116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63
Apr 10 10:32:42 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:43 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63" returned: 0 in 0.661s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7244a4ec-ef92-4db7-b3e8-131798524f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6a9812-9788-4a47-931b-9da816237d63', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fbb02e-ecae-460d-88bc-47f775947ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:43 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Volume volume-7b6a9812-9788-4a47-931b-9da816237d63 (7b6a9812-9788-4a47-931b-9da816237d63): created successfully
Apr 10 10:32:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fbb02e-ecae-460d-88bc-47f775947ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (a851542b-a20f-4dcd-872c-cc745d76ead1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:43 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bbdf1b6d-b32e-45ed-a77a-2feac9c55eb3 tempest-VolumesActionsTest-724539666 None] Created volume successfully.
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Flow 'volume_create_manager' (aae438b0-094d-4d57-993b-63d122ff713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e32d4b-adb2-485b-86b2-24933727f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e32d4b-adb2-485b-86b2-24933727f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-151649323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fbf09e-b28c-45e7-87e4-9ee834e72836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edfc7136fd04b5f8bbb3869c4d0a523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:44Z,use_quota=True,user_id='f133880cf9af43808aec9169be6b3b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b75961-55e9-496f-9d94-f2c44b6c3f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b75961-55e9-496f-9d94-f2c44b6c3f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1032dd-4764-4044-8ec1-a1c85e6f268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1032dd-4764-4044-8ec1-a1c85e6f268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fbf09e-b28c-45e7-87e4-9ee834e72836', 'volume_name': 'volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2566f3-e9d4-43f3-a45c-2512b376cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2566f3-e9d4-43f3-a45c-2512b376cb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a5026e-b79c-4b11-9898-c296f400bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:44 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Volume a3fbf09e-b28c-45e7-87e4-9ee834e72836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836', 'volume_size': 1}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-151649323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fbf09e-b28c-45e7-87e4-9ee834e72836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edfc7136fd04b5f8bbb3869c4d0a523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:44Z,use_quota=True,user_id='f133880cf9af43808aec9169be6b3b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Creating volume a3fbf09e-b28c-45e7-87e4-9ee834e72836 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:44 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:44 devstack sudo[84134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836 1073741824
Apr 10 10:32:44 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-7b6a9812-9788-4a47-931b-9da816237d63-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Lock "cinder-7b6a9812-9788-4a47-931b-9da816237d63-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-quobyte-7b6a9812-9788-4a47-931b-9da816237d63" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-7b6a9812-9788-4a47-931b-9da816237d63" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dafe2b-c72a-46de-89fc-66fa528725fd]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:44 devstack sudo[84137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63
Apr 10 10:32:44 devstack sudo[84137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:44 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836 1073741824" returned: 0 in 0.686s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:45 devstack sudo[84142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836
Apr 10 10:32:45 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:45 devstack sudo[84137]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63" returned: 0 in 0.627s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:45 devstack sudo[84147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63
Apr 10 10:32:45 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:45 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836" returned: 0 in 0.565s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a5026e-b79c-4b11-9898-c296f400bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26989d44-eeff-4f09-a8ad-007d0d40fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:45 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Volume volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836 (a3fbf09e-b28c-45e7-87e4-9ee834e72836): created successfully
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26989d44-eeff-4f09-a8ad-007d0d40fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Flow 'volume_create_manager' (aae438b0-094d-4d57-993b-63d122ff713a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:45 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-fe029cfc-c0ae-4f7b-bd24-f38877597a9f tempest-VolumesTransfersV357Test-483798742 None] Created volume successfully.
Apr 10 10:32:45 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7b6a9812-9788-4a47-931b-9da816237d63" returned: 0 in 0.545s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-7b6a9812-9788-4a47-931b-9da816237d63" released by "delete_volume" :: held 1.200s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Created reservations ['35fb10e6-25b1-4bfd-a4fd-2cd4271f3926', 'c86ee59f-4564-42e8-9a65-88e461b49714', '6568cd9e-6df7-45a4-a8b5-6a9e38592dfd', '2767af80-3bba-403b-879f-009bb04ba0b8'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:45 devstack sudo[84152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:45 devstack sudo[84152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-59e68da1-2017-4175-a12f-85361e5017fc tempest-BackendsCapabilitiesAdminTestsJSON-1805482903 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81969) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 10 10:32:46 devstack sudo[84152]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.491s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:46 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Deleted volume successfully.
Apr 10 10:32:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-dda1e7c7-71ed-444c-b1a3-926e8c4f317d tempest-VolumesActionsTest-354795973 None] Lock "cinder-7b6a9812-9788-4a47-931b-9da816237d63-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88f96e1d-c2f3-49a0-9da4-39c5fdcb5d5d tempest-BackendsCapabilitiesAdminTestsJSON-1805482903 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81969) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 10 10:32:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c27ee045-91cf-4854-beec-2c638429a747 tempest-VolumesTransfersV357Test-802504721 None] Transfer volume completed successfully.
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (6c844b94-94a9-4993-8d7d-e417dfa18d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0d838f-f3bd-4601-81e4-4010bc97b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0d838f-f3bd-4601-81e4-4010bc97b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308921838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60edb7f-7bd4-483d-a2e6-2816676df77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:47Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d034d6e3-2718-455a-8cf2-6fa9c3d92af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d034d6e3-2718-455a-8cf2-6fa9c3d92af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc95af7-864d-4d52-8304-de3d2808b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc95af7-864d-4d52-8304-de3d2808b78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60edb7f-7bd4-483d-a2e6-2816676df77c', 'volume_name': 'volume-f60edb7f-7bd4-483d-a2e6-2816676df77c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39e2c14-f9d3-42d8-afc1-560dcec64f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39e2c14-f9d3-42d8-afc1-560dcec64f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cc1a9a-7e00-42cb-97c0-cae4495906bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:47 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Volume f60edb7f-7bd4-483d-a2e6-2816676df77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60edb7f-7bd4-483d-a2e6-2816676df77c', 'volume_size': 1}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308921838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60edb7f-7bd4-483d-a2e6-2816676df77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:47Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Creating volume f60edb7f-7bd4-483d-a2e6-2816676df77c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:47 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:47 devstack sudo[84158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c 1073741824
Apr 10 10:32:47 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Acquiring lock "cinder-a3fbf09e-b28c-45e7-87e4-9ee834e72836-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-a3fbf09e-b28c-45e7-87e4-9ee834e72836-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Acquiring lock "cinder-quobyte-a3fbf09e-b28c-45e7-87e4-9ee834e72836" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-quobyte-a3fbf09e-b28c-45e7-87e4-9ee834e72836" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[32528d1a-75a2-41e5-b4b6-a186601120dd]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:48 devstack sudo[84161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836
Apr 10 10:32:48 devstack sudo[84161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:48 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c 1073741824" returned: 0 in 0.878s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:48 devstack sudo[84188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c
Apr 10 10:32:48 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:48 devstack sudo[84161]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836" returned: 0 in 0.946s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:48 devstack sudo[84201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836
Apr 10 10:32:48 devstack sudo[84201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:49 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c" returned: 0 in 0.879s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cc1a9a-7e00-42cb-97c0-cae4495906bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60edb7f-7bd4-483d-a2e6-2816676df77c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34616868-9de8-476c-b989-e82b270b5645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:49 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Volume volume-f60edb7f-7bd4-483d-a2e6-2816676df77c (f60edb7f-7bd4-483d-a2e6-2816676df77c): created successfully
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34616868-9de8-476c-b989-e82b270b5645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (6c844b94-94a9-4993-8d7d-e417dfa18d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:49 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bd699fce-f163-41c9-9376-76708c1a925b tempest-VolumesActionsTest-724539666 None] Created volume successfully.
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-f60edb7f-7bd4-483d-a2e6-2816676df77c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Lock "cinder-f60edb7f-7bd4-483d-a2e6-2816676df77c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:49 devstack sudo[84201]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a3fbf09e-b28c-45e7-87e4-9ee834e72836" returned: 0 in 0.904s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-quobyte-a3fbf09e-b28c-45e7-87e4-9ee834e72836" released by "delete_volume" :: held 1.907s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Acquiring lock "cinder-quobyte-f60edb7f-7bd4-483d-a2e6-2816676df77c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-f60edb7f-7bd4-483d-a2e6-2816676df77c" acquired by "delete_volume" :: waited 0.035s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3be71e-9426-4910-b62c-5a09634d2b78]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:49 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Created reservations ['9fa34c89-a567-463e-bb6c-8541fd1ffd0f', '99eb8177-74a6-4f63-b074-a78192a382d2', 'f930b7ed-e77d-466d-b01f-e0840f48125a', '72f92579-73a7-4b25-88ca-64280f8d5026'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:50 devstack sudo[84207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c
Apr 10 10:32:50 devstack sudo[84207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:50 devstack sudo[84208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:50 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:50 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.666s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:50 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Deleted volume successfully.
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4738d97a-b01d-44ea-ab06-7ee9438f28d8 tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-a3fbf09e-b28c-45e7-87e4-9ee834e72836-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Flow 'volume_create_manager' (ba697bb2-35c1-413f-99bf-2f9bd8ba7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d66077e-c333-4ea2-9b20-9f5719cec829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d66077e-c333-4ea2-9b20-9f5719cec829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-287723655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087e4231-72a9-4545-b4aa-cc66a75829e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edfc7136fd04b5f8bbb3869c4d0a523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:51Z,use_quota=True,user_id='f133880cf9af43808aec9169be6b3b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3db726-1d73-41f8-8f2f-ea424d00d6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:50 devstack sudo[84207]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3db726-1d73-41f8-8f2f-ea424d00d6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f38942-7d42-4150-a97f-923b81541c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f38942-7d42-4150-a97f-923b81541c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087e4231-72a9-4545-b4aa-cc66a75829e8', 'volume_name': 'volume-087e4231-72a9-4545-b4aa-cc66a75829e8', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573f2739-c3fc-40d6-be79-66f9ddb70a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573f2739-c3fc-40d6-be79-66f9ddb70a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f2051c-8b9d-451c-814e-2f8458e77de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:50 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Volume 087e4231-72a9-4545-b4aa-cc66a75829e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087e4231-72a9-4545-b4aa-cc66a75829e8', 'volume_size': 1}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-287723655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087e4231-72a9-4545-b4aa-cc66a75829e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edfc7136fd04b5f8bbb3869c4d0a523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:51Z,use_quota=True,user_id='f133880cf9af43808aec9169be6b3b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Creating volume 087e4231-72a9-4545-b4aa-cc66a75829e8 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:50 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c" returned: 0 in 1.008s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:50 devstack sudo[84215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8 1073741824
Apr 10 10:32:50 devstack sudo[84215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:51 devstack sudo[84216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c
Apr 10 10:32:51 devstack sudo[84216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:51 devstack sudo[84216]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f60edb7f-7bd4-483d-a2e6-2816676df77c" returned: 0 in 0.750s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Lock "cinder-quobyte-f60edb7f-7bd4-483d-a2e6-2816676df77c" released by "delete_volume" :: held 1.813s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:51 devstack sudo[84215]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8 1073741824" returned: 0 in 0.848s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Created reservations ['ca398784-2b6d-43e6-a32b-22d052387d85', '35eee8e1-ef55-4352-a5e1-c66a3688fc64', '43bd2656-46b8-4097-949d-568df7557d9a', '87d4e372-4b6e-48c3-9e7c-246822a3b7bd'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:51 devstack sudo[84223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8
Apr 10 10:32:51 devstack sudo[84223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:51 devstack sudo[84225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:51 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:52 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.737s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f1cc13d9-8acd-4ac4-a789-2d47f455a124 tempest-GroupSnapshotsTest-1554300411 None] Group tempest-GroupSnapshotsTest-Group-619898836: creating
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Deleted volume successfully.
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f1cc13d9-8acd-4ac4-a789-2d47f455a124 tempest-GroupSnapshotsTest-1554300411 None] Group tempest-GroupSnapshotsTest-Group-619898836: created successfully
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b7650495-ab5f-4613-bfd6-27c3d1f0355f tempest-VolumesActionsTest-354795973 None] Lock "cinder-f60edb7f-7bd4-483d-a2e6-2816676df77c-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f1cc13d9-8acd-4ac4-a789-2d47f455a124 tempest-GroupSnapshotsTest-1554300411 None] Create group completed successfully.
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (0f9b9cff-d80c-454b-be15-4ad95d2305e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5786530-69f0-48a8-9e30-f2d6c825f023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5786530-69f0-48a8-9e30-f2d6c825f023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956866630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82df570-b67e-4ea1-839b-a973e69d5c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:53Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af88f946-75fc-410b-bd23-9670cbc04ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af88f946-75fc-410b-bd23-9670cbc04ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c47e07c-25f7-4527-a29b-6e804aec22a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c47e07c-25f7-4527-a29b-6e804aec22a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82df570-b67e-4ea1-839b-a973e69d5c42', 'volume_name': 'volume-a82df570-b67e-4ea1-839b-a973e69d5c42', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:52 devstack sudo[84223]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662f296c-8589-48f7-b0b4-05c02644ba36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662f296c-8589-48f7-b0b4-05c02644ba36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca028612-b4e1-465b-83d4-8938644e2cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Volume a82df570-b67e-4ea1-839b-a973e69d5c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82df570-b67e-4ea1-839b-a973e69d5c42', 'volume_size': 1}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8" returned: 0 in 1.060s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956866630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82df570-b67e-4ea1-839b-a973e69d5c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7f714d77984451884720f8bf5930fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:53Z,use_quota=True,user_id='d0283489dd414a50a27f43d97a675d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Creating volume a82df570-b67e-4ea1-839b-a973e69d5c42 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f2051c-8b9d-451c-814e-2f8458e77de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087e4231-72a9-4545-b4aa-cc66a75829e8', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:52 devstack sudo[84229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42 1073741824
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fa72d0-18d7-4bdd-9b0c-959eee18b4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:52 devstack sudo[84229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Volume volume-087e4231-72a9-4545-b4aa-cc66a75829e8 (087e4231-72a9-4545-b4aa-cc66a75829e8): created successfully
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fa72d0-18d7-4bdd-9b0c-959eee18b4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Flow 'volume_create_manager' (ba697bb2-35c1-413f-99bf-2f9bd8ba7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b586fad5-1232-4d2d-940e-6962920eeedd tempest-VolumesTransfersV357Test-483798742 None] Created volume successfully.
Apr 10 10:32:53 devstack sudo[84229]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42 1073741824" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:53 devstack sudo[84234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42
Apr 10 10:32:53 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:54 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42" returned: 0 in 0.501s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca028612-b4e1-465b-83d4-8938644e2cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82df570-b67e-4ea1-839b-a973e69d5c42', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f50089e-7d5f-4eb2-b01e-d8c326efbc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Volume volume-a82df570-b67e-4ea1-839b-a973e69d5c42 (a82df570-b67e-4ea1-839b-a973e69d5c42): created successfully
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f50089e-7d5f-4eb2-b01e-d8c326efbc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Flow 'volume_create_manager' (0f9b9cff-d80c-454b-be15-4ad95d2305e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:54 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-393c4fee-cd2c-4e3b-ba21-11c37875f11c tempest-VolumesActionsTest-724539666 None] Created volume successfully.
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (8e84fb7e-cc5c-4637-8bb1-7487abaa73ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c36c68-35c5-46be-ab74-57917d4d1c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c36c68-35c5-46be-ab74-57917d4d1c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-144891996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b724397f-caae-4aff-a15a-9f28a6cef04d,host='devstack@QuobyteHD#QuobyteHD',id=a93140ba-44f1-4eda-b65f-582f6aa561ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:54Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd0b3bb0-c153-45fb-b599-79600b49c3a8),volume_type_id=dd0b3bb0-c153-45fb-b599-79600b49c3a8)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34af194-7f68-4806-86d4-0263ad9ee254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34af194-7f68-4806-86d4-0263ad9ee254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a493ba-6e98-4e78-bcf0-cc5e4afbc035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a493ba-6e98-4e78-bcf0-cc5e4afbc035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93140ba-44f1-4eda-b65f-582f6aa561ec', 'volume_name': 'volume-a93140ba-44f1-4eda-b65f-582f6aa561ec', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c48f836-aa08-4c36-9dbe-75d3710c2738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c48f836-aa08-4c36-9dbe-75d3710c2738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb8a080-c6d6-45a7-a1f1-e88821cc445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Volume a93140ba-44f1-4eda-b65f-582f6aa561ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93140ba-44f1-4eda-b65f-582f6aa561ec', 'volume_size': 1}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b724397f-caae-4aff-a15a-9f28a6cef04d,created_at=2026-04-10T08:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-144891996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b724397f-caae-4aff-a15a-9f28a6cef04d,host='devstack@QuobyteHD#QuobyteHD',id=a93140ba-44f1-4eda-b65f-582f6aa561ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:54Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd0b3bb0-c153-45fb-b599-79600b49c3a8),volume_type_id=dd0b3bb0-c153-45fb-b599-79600b49c3a8)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Creating volume a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:32:54 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:54 devstack sudo[84237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec 1073741824
Apr 10 10:32:54 devstack sudo[84237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Acquiring lock "cinder-087e4231-72a9-4545-b4aa-cc66a75829e8-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-087e4231-72a9-4545-b4aa-cc66a75829e8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Acquiring lock "cinder-quobyte-087e4231-72a9-4545-b4aa-cc66a75829e8" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-quobyte-087e4231-72a9-4545-b4aa-cc66a75829e8" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a333a-3819-40fa-87b9-61349d886497]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:54 devstack sudo[84239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8
Apr 10 10:32:54 devstack sudo[84239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:54 devstack sudo[84237]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec 1073741824" returned: 0 in 0.590s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:54 devstack sudo[84244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec
Apr 10 10:32:54 devstack sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:55 devstack sudo[84239]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8" returned: 0 in 0.730s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:55 devstack sudo[84249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8
Apr 10 10:32:55 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:55 devstack sudo[84244]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec" returned: 0 in 0.787s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb8a080-c6d6-45a7-a1f1-e88821cc445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93140ba-44f1-4eda-b65f-582f6aa561ec', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d09cb59-89b1-4c9d-9269-25a668c32f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Acquiring lock "cinder-a82df570-b67e-4ea1-839b-a973e69d5c42-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Lock "cinder-a82df570-b67e-4ea1-839b-a973e69d5c42-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:55 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Volume volume-a93140ba-44f1-4eda-b65f-582f6aa561ec (a93140ba-44f1-4eda-b65f-582f6aa561ec): created successfully
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d09cb59-89b1-4c9d-9269-25a668c32f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (8e84fb7e-cc5c-4637-8bb1-7487abaa73ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Acquiring lock "cinder-quobyte-a82df570-b67e-4ea1-839b-a973e69d5c42" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:32:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-96a509fb-b5dd-4236-bdcb-9881a33d42b3 tempest-GroupSnapshotsTest-1554300411 None] Created volume successfully.
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Lock "cinder-quobyte-a82df570-b67e-4ea1-839b-a973e69d5c42" acquired by "delete_volume" :: waited 0.025s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5afd009-630c-49cc-a84b-62092b7c6ebd]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:55 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-087e4231-72a9-4545-b4aa-cc66a75829e8" returned: 0 in 0.686s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-quobyte-087e4231-72a9-4545-b4aa-cc66a75829e8" released by "delete_volume" :: held 1.446s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:55 devstack sudo[84303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42
Apr 10 10:32:55 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:55 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Created reservations ['45e7b88e-fa11-4045-af92-69bb7f1d0a42', '0244f005-2c31-43dc-963c-36bf2f90d79d', '6e1d6f0e-dbbb-4b88-9521-e59fdc566ba0', 'ac7894d6-8648-4a46-a0a8-df5e441689d4'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:56 devstack sudo[84310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:56 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:56 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42" returned: 0 in 0.668s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:56 devstack sudo[84330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42
Apr 10 10:32:56 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:56 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.872s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Deleted volume successfully.
Apr 10 10:32:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] GroupSnapshot 6f19c408-4852-4d65-bedd-cae9ec69072a: creating.
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Group snapshot 6f19c408-4852-4d65-bedd-cae9ec69072a: creating. {{(pid=81969) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9f5aff7a-9af6-4530-9b3d-34c704b365ff tempest-VolumesTransfersV357Test-1270660269 None] Lock "cinder-087e4231-72a9-4545-b4aa-cc66a75829e8-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Creating offline snapshot 208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 of volume a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[02387e61-4e98-45f5-877a-1bbdb4f6cd00]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:57 devstack sudo[84379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec
Apr 10 10:32:57 devstack sudo[84379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:57 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a82df570-b67e-4ea1-839b-a973e69d5c42" returned: 0 in 0.884s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Lock "cinder-quobyte-a82df570-b67e-4ea1-839b-a973e69d5c42" released by "delete_volume" :: held 1.591s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Created reservations ['f5e7115a-76dc-4329-8328-063d223cab0e', 'de43b781-58a3-4bdf-9847-650f9d730eb8', '702e65da-f644-44d4-83d5-7d4e799e113a', '67a489e1-fe36-44f3-9ed4-573cf204b904'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:57 devstack sudo[84382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:32:57 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:57 devstack sudo[84379]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec" returned: 0 in 0.844s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:57 devstack sudo[84387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 1G
Apr 10 10:32:57 devstack sudo[84387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:58 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.679s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:58 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:32:58 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Deleted volume successfully.
Apr 10 10:32:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-df1071c6-2d65-41fc-8acf-1ba5dcefc79c tempest-VolumesActionsTest-724539666 None] Lock "cinder-a82df570-b67e-4ea1-839b-a973e69d5c42-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:32:58 devstack sudo[84387]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 1G" returned: 0 in 0.894s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93140ba-44f1-4eda-b65f-582f6aa561ec -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:58 devstack sudo[84394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93140ba-44f1-4eda-b65f-582f6aa561ec -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223
Apr 10 10:32:58 devstack sudo[84394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:32:59 devstack sudo[84394]: pam_unix(sudo:session): session closed for user root
Apr 10 10:32:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93140ba-44f1-4eda-b65f-582f6aa561ec -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" returned: 0 in 0.731s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:32:59 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:32:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:32:59 devstack sudo[84400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223
Apr 10 10:32:59 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:00 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" returned: 0 in 0.913s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:00 devstack sudo[84404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.info
Apr 10 10:33:00 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:01 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.info" returned: 0 in 0.627s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:01 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:33:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:01 devstack sudo[84407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.info
Apr 10 10:33:01 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:01 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.info" returned: 0 in 0.911s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.989s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:02 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-979f83f1-2792-4979-8845-cef3f221a353 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot 6f19c408-4852-4d65-bedd-cae9ec69072a: created successfully
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-208ac2bc-7cf8-44d2-80ef-bcaf6a58a223-825d89ab-b1d4-48fb-baf1-6de18bdf235e" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-208ac2bc-7cf8-44d2-80ef-bcaf6a58a223-825d89ab-b1d4-48fb-baf1-6de18bdf235e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Creating volume 825d89ab-b1d4-48fb-baf1-6de18bdf235e from snapshot 208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-825d89ab-b1d4-48fb-baf1-6de18bdf235e" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-825d89ab-b1d4-48fb-baf1-6de18bdf235e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] snapshot: 208ac2bc-7cf8-44d2-80ef-bcaf6a58a223, volume: 825d89ab-b1d4-48fb-baf1-6de18bdf235e,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b539252-72d7-4724-b812-8511648ae978]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Flow 'volume_create_manager' (182aa51e-dc72-43d5-8b0a-15f2c2043838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899379ac-9a20-4686-81af-8f2cad77b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899379ac-9a20-4686-81af-8f2cad77b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1137426482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791fb18b-883c-43e9-9234-baa3e29310b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587d53ff9bf246e0822796a372108d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:04Z,use_quota=True,user_id='942a01883cec415787b4e8a32c8ae67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:03 devstack sudo[84411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223
Apr 10 10:33:03 devstack sudo[84411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc54d116-0c17-48c3-a921-43fdf1622f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc54d116-0c17-48c3-a921-43fdf1622f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e47526-271d-4eab-9012-5e7c2b8cb441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:03 devstack cinder-volume[81969]: DEBUG cinder.image.glance [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Creating Keystone auth plugin from conf {{(pid=81969) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e47526-271d-4eab-9012-5e7c2b8cb441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '791fb18b-883c-43e9-9234-baa3e29310b9', 'volume_name': 'volume-791fb18b-883c-43e9-9234-baa3e29310b9', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d80ac760>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63bed42-eb25-4f47-8375-718ce4e552e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63bed42-eb25-4f47-8375-718ce4e552e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610ae241-783c-4443-ae39-4db9b2602fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:04 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Volume 791fb18b-883c-43e9-9234-baa3e29310b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-791fb18b-883c-43e9-9234-baa3e29310b9', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d80ac760>}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Trying to clone 791fb18b-883c-43e9-9234-baa3e29310b9 from image 2fe75249-df95-461c-a1b7-506809038618 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]). {{(pid=81969) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 10:33:04 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04cddf5-6860-45c9-87f6-87cb5ab3f851]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:04 devstack sudo[84417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD
Apr 10 10:33:04 devstack sudo[84417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:04 devstack sudo[84411]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" returned: 0 in 0.834s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a93140ba-44f1-4eda-b65f-582f6aa561ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e112d719-59d8-49ee-a710-d6bc5ae6b503]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:04 devstack sudo[84420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec
Apr 10 10:33:04 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:05 devstack sudo[84417]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD" returned: 0 in 0.709s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:05 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 is fetched for user 942a01883cec415787b4e8a32c8ae67b. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 10:33:05 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9b969-bcd2-4294-b154-8e5c716cadf2]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:05 devstack sudo[84425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD
Apr 10 10:33:05 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:05 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec" returned: 0 in 0.849s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:05 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:33:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:05 devstack sudo[84430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e
Apr 10 10:33:05 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:06 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:09 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e" returned: 0 in 3.855s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:09 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c310c8f8-81d6-425c-af8b-8ec1b06b176e]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:09 devstack sudo[84463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec
Apr 10 10:33:09 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Flow 'volume_create_manager' (bab371d5-aa70-4983-82d9-ff7de2ad3ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad07265-4e7f-4bc0-8ac8-4cc7a4fe1710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad07265-4e7f-4bc0-8ac8-4cc7a4fe1710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:10Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba72461-95cf-4cc7-8a9d-3931e210119c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b99a0c9e18a4710b9488006452fa5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:10Z,use_quota=True,user_id='1ffbb757ec3a420ab6688f1c2f2a9748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9726dc-7b0d-4386-8fa2-e6685b4c4bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9726dc-7b0d-4386-8fa2-e6685b4c4bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94252103-de1a-4b93-824f-9157cd6690bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.image.glance [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Creating Keystone auth plugin from conf {{(pid=81969) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94252103-de1a-4b93-824f-9157cd6690bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cba72461-95cf-4cc7-8a9d-3931e210119c', 'volume_name': 'volume-cba72461-95cf-4cc7-8a9d-3931e210119c', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d7eec7c0>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e26ddf7-aff1-480c-96e1-f5e31b7d135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e26ddf7-aff1-480c-96e1-f5e31b7d135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04261a3-269e-4372-be83-21b14032aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:10 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Volume cba72461-95cf-4cc7-8a9d-3931e210119c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cba72461-95cf-4cc7-8a9d-3931e210119c', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d7eec7c0>}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Trying to clone cba72461-95cf-4cc7-8a9d-3931e210119c from image 2fe75249-df95-461c-a1b7-506809038618 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]). {{(pid=81969) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 10:33:10 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec" returned: 0 in 1.295s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec, size 1024.00 MB, duration 3.86 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:33:10 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Converted 1024.00 MB image at 265.58 MB/s
Apr 10 10:33:10 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:10 devstack sudo[84468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e
Apr 10 10:33:10 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 10:33:10 devstack cinder-volume[81969]: INFO cinder.image.image_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4788617b-7da6-4b8a-b17d-9840c8d8a847]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:11 devstack sudo[84471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD
Apr 10 10:33:11 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:11 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e" returned: 0 in 0.806s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-825d89ab-b1d4-48fb-baf1-6de18bdf235e" released by "_copy_volume_from_snapshot" :: held 7.750s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-208ac2bc-7cf8-44d2-80ef-bcaf6a58a223-825d89ab-b1d4-48fb-baf1-6de18bdf235e" released by "_create_volume_from_snapshot" :: held 7.793s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.812s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.468s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1137426482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791fb18b-883c-43e9-9234-baa3e29310b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587d53ff9bf246e0822796a372108d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:04Z,use_quota=True,user_id='942a01883cec415787b4e8a32c8ae67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Creating volume 791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:11 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:11 devstack sudo[84478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 1073741824
Apr 10 10:33:11 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:11 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-21a5399b-c593-4f28-b4d2-683358af4cae tempest-GroupSnapshotsTest-1554300411 None] Create group from source-snapshot-6f19c408-4852-4d65-bedd-cae9ec69072a completed successfully.
Apr 10 10:33:11 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD" returned: 0 in 1.052s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:11 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 is fetched for user 1ffbb757ec3a420ab6688f1c2f2a9748. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97eb271-5fe0-4d5f-97f9-513f91cb1584]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:12 devstack sudo[84492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD
Apr 10 10:33:12 devstack sudo[84492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:12 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 1073741824" returned: 0 in 0.966s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:12 devstack sudo[84497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:12 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-825d89ab-b1d4-48fb-baf1-6de18bdf235e" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-825d89ab-b1d4-48fb-baf1-6de18bdf235e" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64882bd-58fd-47ed-895c-89ecd1365b4c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:12 devstack sudo[84492]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:13 devstack sudo[84525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e
Apr 10 10:33:13 devstack sudo[84525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Flow 'volume_create_manager' (872ee65b-589a-4534-811a-b7be862100be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad350272-315e-458d-bcd0-fb2e04aa51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad350272-315e-458d-bcd0-fb2e04aa51f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-398653836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e00188-af53-43a6-9cb8-191e800b868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a039156add4e6b9ace28925096bd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:13Z,use_quota=True,user_id='95796e6ffebe49879c1752f839cb0bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377a840a-ee6b-42b6-bcfb-e2a7b0091453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377a840a-ee6b-42b6-bcfb-e2a7b0091453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed945773-f1f8-4e7f-b305-12609ea816ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed945773-f1f8-4e7f-b305-12609ea816ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e00188-af53-43a6-9cb8-191e800b868a', 'volume_name': 'volume-03e00188-af53-43a6-9cb8-191e800b868a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361f23a8-ccff-482e-9a83-147346fcea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361f23a8-ccff-482e-9a83-147346fcea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb8758f-48f5-4a64-80c1-b1a87449ef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:13 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Volume 03e00188-af53-43a6-9cb8-191e800b868a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e00188-af53-43a6-9cb8-191e800b868a', 'volume_size': 1}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:13 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 0 in 0.706s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:10Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba72461-95cf-4cc7-8a9d-3931e210119c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b99a0c9e18a4710b9488006452fa5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:10Z,use_quota=True,user_id='1ffbb757ec3a420ab6688f1c2f2a9748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Creating volume cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:13 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:13 devstack sudo[84528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c 1073741824
Apr 10 10:33:13 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Attempting download of 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume 791fb18b-883c-43e9-9234-baa3e29310b9. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8744273-f524-4b71-bf04-d5930655ef33]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_t0qt5z9o {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:13 devstack sudo[84530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_t0qt5z9o
Apr 10 10:33:13 devstack sudo[84530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:13 devstack sudo[84525]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e" returned: 0 in 0.795s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:13 devstack sudo[84538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e
Apr 10 10:33:13 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:13 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c 1073741824" returned: 0 in 0.609s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:13 devstack sudo[84540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:13 devstack sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:14 devstack sudo[84530]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_t0qt5z9o" returned: 0 in 0.694s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_t0qt5z9o {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:14 devstack sudo[84544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_t0qt5z9o
Apr 10 10:33:14 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:14 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-825d89ab-b1d4-48fb-baf1-6de18bdf235e" returned: 0 in 0.685s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-825d89ab-b1d4-48fb-baf1-6de18bdf235e" released by "delete_volume" :: held 1.514s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['e575ce5b-6ea4-4bb4-9f0a-2bdca630bb4f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:14 devstack cinder-volume[81969]: WARNING cinder.quota [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-517956193 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-517956193, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:33:14 devstack cinder-volume[81969]: WARNING cinder.quota [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-517956193 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-517956193, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['93e999cf-912a-49ea-b344-33f07f4d4799', 'd02da4b0-7f4d-4984-a303-ed9f0fee5411', '3d68282d-5cdd-4268-8419-0a1ff15410d8', '530661a9-bed2-4e71-bfbc-e0fd78dd72e0'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:14 devstack sudo[84540]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 0 in 0.705s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:14 devstack sudo[84550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:14 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-398653836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e00188-af53-43a6-9cb8-191e800b868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a039156add4e6b9ace28925096bd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:13Z,use_quota=True,user_id='95796e6ffebe49879c1752f839cb0bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Creating volume 03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:14 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Attempting download of 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume cba72461-95cf-4cc7-8a9d-3931e210119c. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 10:33:14 devstack sudo[84552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a 1073741824
Apr 10 10:33:14 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:14 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_t0qt5z9o" returned: 1 in 0.675s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_t0qt5z9o' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd597d61-3e28-446d-bbb1-7b433f73b7eb]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[760feb3a-6099-4497-b1a8-72920570d9c0]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_116h71nx {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:14 devstack sudo[84554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD
Apr 10 10:33:14 devstack sudo[84554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:14 devstack sudo[84555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_116h71nx
Apr 10 10:33:14 devstack sudo[84555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:15 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot 6f19c408-4852-4d65-bedd-cae9ec69072a: deleting
Apr 10 10:33:15 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot 6f19c408-4852-4d65-bedd-cae9ec69072a: deleting {{(pid=81969) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.672s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:15 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-655eeb90-10f5-416a-b5ed-02219bf3d3d3 tempest-GroupSnapshotsTest-1554300411 None] Delete group completed successfully.
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-a93140ba-44f1-4eda-b65f-582f6aa561ec" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-a93140ba-44f1-4eda-b65f-582f6aa561ec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Deleting offline snapshot 208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 of volume a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] snapshot_file for this snap is: volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe9f3f-8e42-4767-9050-f71e04da960a]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:15 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:15 devstack sudo[84562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223
Apr 10 10:33:15 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a 1073741824" returned: 0 in 0.908s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:15 devstack sudo[84555]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_116h71nx" returned: 0 in 0.806s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_116h71nx {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:15 devstack sudo[84570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a
Apr 10 10:33:15 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:15 devstack sudo[84567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_116h71nx
Apr 10 10:33:15 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:15 devstack sudo[84554]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD" returned: 0 in 0.933s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] 2fe75249-df95-461c-a1b7-506809038618 was qcow2, converting to raw {{(pid=81969) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 10:33:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:15 devstack sudo[84573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:15 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:16 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_116h71nx" returned: 1 in 0.575s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_116h71nx' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[45450b58-4055-44c1-99a0-de4d83b31efe]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:16 devstack sudo[84577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD
Apr 10 10:33:16 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:16 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" returned: 0 in 1.013s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a93140ba-44f1-4eda-b65f-582f6aa561ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847fac5-b45c-4bba-bde3-37ae26e55713]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:16 devstack sudo[84600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec
Apr 10 10:33:16 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:16 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a" returned: 0 in 0.963s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb8758f-48f5-4a64-80c1-b1a87449ef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e00188-af53-43a6-9cb8-191e800b868a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6ed6ca-eb99-44ba-8297-38deaf1e22ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=117,cinder:UPDATE=175,cinder:INSERT=39,cinder:DELETE=15 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:33:16 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Volume volume-03e00188-af53-43a6-9cb8-191e800b868a (03e00188-af53-43a6-9cb8-191e800b868a): created successfully
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6ed6ca-eb99-44ba-8297-38deaf1e22ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Flow 'volume_create_manager' (872ee65b-589a-4534-811a-b7be862100be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:16 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ff310da4-eba3-4b19-a14e-d891ea3c0796 tempest-SnapshotMetadataTestJSON-670118891 None] Created volume successfully.
Apr 10 10:33:17 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] 2fe75249-df95-461c-a1b7-506809038618 was qcow2, converting to raw {{(pid=81969) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:17 devstack sudo[84609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:17 devstack sudo[84609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:17 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec" returned: 0 in 0.602s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:17 devstack sudo[84611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223
Apr 10 10:33:17 devstack sudo[84611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:17 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 0 in 1.467s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_yvfar4nodevstack@QuobyteHD, size 112.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:33:17 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Converted 112.00 MB image at 76.26 MB/s
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:17 devstack sudo[84613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 1G
Apr 10 10:33:17 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Creating offline snapshot b7cb1d58-26b4-4e28-8e7d-b4d746a5356c of volume 03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b23c88-a58d-42ce-a000-06c5f3e30497]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:17 devstack sudo[84611]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" returned: 0 in 0.874s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:17 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 1G" returned: 0 in 0.769s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:17 devstack sudo[84628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223
Apr 10 10:33:17 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:17 devstack sudo[84627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a
Apr 10 10:33:17 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d0f5fb-fd2e-419a-b02b-f93d02323176]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:18 devstack sudo[84631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:18 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:18 devstack sudo[84609]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 0 in 1.349s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_x4yrxw9zdevstack@QuobyteHD, size 112.00 MB, duration 1.35 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:33:18 devstack cinder-volume[81969]: INFO cinder.image.image_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Converted 112.00 MB image at 82.92 MB/s
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:18 devstack sudo[84634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c 1G
Apr 10 10:33:18 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:18 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec.208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" returned: 0 in 0.549s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-208ac2bc-7cf8-44d2-80ef-bcaf6a58a223" released by "_delete_snapshot" :: held 3.105s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-a93140ba-44f1-4eda-b65f-582f6aa561ec" released by "delete_snapshot" :: held 3.131s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:18 devstack cinder-volume[81969]: WARNING cinder.quota [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-517956193 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-517956193, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['bae3deaf-739f-4f5b-a54c-e4df15d560e4', '46307244-3048-46e2-b63f-335c12489bb7', '5ada2673-448b-4bf1-bb0d-300fa34ac990', 'def3332e-0fe7-4c9a-ad63-ab86b697f9b1'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:18 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-73dbd967-d523-4b11-af57-09e31aaf4d51 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot 6f19c408-4852-4d65-bedd-cae9ec69072a: deleted successfully
Apr 10 10:33:18 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a" returned: 0 in 0.832s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:18 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c 1G
Apr 10 10:33:18 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:18 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 0 in 0.816s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:18 devstack sudo[84643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:18 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:18 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c 1G" returned: 0 in 0.637s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d8fde4-2b5a-4f5b-b695-d8380e93b2aa]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:19 devstack sudo[84648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:19 devstack sudo[84648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:19 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c 1G" returned: 0 in 0.738s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03e00188-af53-43a6-9cb8-191e800b868a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:19 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 1 in 0.625s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Downloaded image 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume 791fb18b-883c-43e9-9234-baa3e29310b9 successfully. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 for user 942a01883cec415787b4e8a32c8ae67b is deleted. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Marking volume 791fb18b-883c-43e9-9234-baa3e29310b9 as bootable. {{(pid=81969) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Copying metadata from image 2fe75249-df95-461c-a1b7-506809038618 to 791fb18b-883c-43e9-9234-baa3e29310b9. {{(pid=81969) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Creating volume glance metadata for volume 791fb18b-883c-43e9-9234-baa3e29310b9 backed by image 2fe75249-df95-461c-a1b7-506809038618 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81969) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 10:33:19 devstack sudo[84657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03e00188-af53-43a6-9cb8-191e800b868a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c
Apr 10 10:33:19 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610ae241-783c-4443-ae39-4db9b2602fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791fb18b-883c-43e9-9234-baa3e29310b9', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d80ac760>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84aee2d6-f7e6-4022-b4f7-20c4ee6a39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:19 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Volume volume-791fb18b-883c-43e9-9234-baa3e29310b9 (791fb18b-883c-43e9-9234-baa3e29310b9): created successfully
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84aee2d6-f7e6-4022-b4f7-20c4ee6a39ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Flow 'volume_create_manager' (182aa51e-dc72-43d5-8b0a-15f2c2043838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a4017fa4-32a1-40ee-a08c-d182bda884bd tempest-VolumesExtendTest-1665019589 None] Created volume successfully.
Apr 10 10:33:19 devstack sudo[84648]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 0 in 0.589s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:19 devstack sudo[84661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:19 devstack sudo[84661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-a93140ba-44f1-4eda-b65f-582f6aa561ec" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-a93140ba-44f1-4eda-b65f-582f6aa561ec" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c4894-c96e-4903-84a6-0170e257a96b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:19 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03e00188-af53-43a6-9cb8-191e800b868a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" returned: 0 in 0.597s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:19 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c is being set with open permissions: ugo+rw
Apr 10 10:33:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:20 devstack sudo[84667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c
Apr 10 10:33:20 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:20 devstack sudo[84666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec
Apr 10 10:33:20 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:20 devstack sudo[84661]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 1 in 0.600s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Downloaded image 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume cba72461-95cf-4cc7-8a9d-3931e210119c successfully. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 for user 1ffbb757ec3a420ab6688f1c2f2a9748 is deleted. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Marking volume cba72461-95cf-4cc7-8a9d-3931e210119c as bootable. {{(pid=81969) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Copying metadata from image 2fe75249-df95-461c-a1b7-506809038618 to cba72461-95cf-4cc7-8a9d-3931e210119c. {{(pid=81969) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Creating volume glance metadata for volume cba72461-95cf-4cc7-8a9d-3931e210119c backed by image 2fe75249-df95-461c-a1b7-506809038618 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81969) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04261a3-269e-4372-be83-21b14032aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba72461-95cf-4cc7-8a9d-3931e210119c', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d7eec7c0>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac93d05-32ae-40a1-8a8f-75b2482be27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:20 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Volume volume-cba72461-95cf-4cc7-8a9d-3931e210119c (cba72461-95cf-4cc7-8a9d-3931e210119c): created successfully
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac93d05-32ae-40a1-8a8f-75b2482be27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Flow 'volume_create_manager' (bab371d5-aa70-4983-82d9-ff7de2ad3ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:20 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-d850455f-9873-4056-b423-9d7a6d197241 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Created volume successfully.
Apr 10 10:33:20 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" returned: 0 in 0.535s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:20 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec" returned: 0 in 0.603s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:20 devstack sudo[84677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.info
Apr 10 10:33:20 devstack sudo[84678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec
Apr 10 10:33:20 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:20 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:21 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a93140ba-44f1-4eda-b65f-582f6aa561ec" returned: 0 in 0.505s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-a93140ba-44f1-4eda-b65f-582f6aa561ec" released by "delete_volume" :: held 1.170s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:21 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.info" returned: 0 in 0.551s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:21 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.info is being set with open permissions: ugo+rw
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:21 devstack sudo[84683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.info
Apr 10 10:33:21 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['52252a9a-a80c-4cb4-a1c7-a004479826ec'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:21 devstack cinder-volume[81969]: WARNING cinder.db.sqlalchemy.api [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-517956193']
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['56148f90-720f-41b6-a078-426417f8f2ba', 'f729cf49-005d-4e3c-abfb-4d7bb11fa462', '1f0fa68b-571f-4cf9-9459-3b2a341bdfb1', '3cd4ede7-4919-4e82-8ebc-344168eaf597'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:21 devstack sudo[84685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:21 devstack sudo[84685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:21 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.info" returned: 0 in 0.469s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.797s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.933s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5ca4d337-a430-4b5d-b7cf-34b8244e9378 tempest-SnapshotMetadataTestJSON-670118891 None] Create snapshot completed successfully
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86a8ec-0ddd-449e-8f00-26967c10eedd]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:21 devstack sudo[84688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:21 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:21 devstack sudo[84685]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.469s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:21 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-8485a1d2-09b1-43e4-acb0-de6d64cc9ace tempest-GroupSnapshotsTest-1554300411 None] Delete group completed successfully.
Apr 10 10:33:22 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 0 in 0.571s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:22 devstack sudo[84694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:22 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:22 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-59a35a42-2879-4e5a-8078-3c49c2b4cca8 tempest-GroupSnapshotsTest-1554300411 None] Group tempest-GroupSnapshotsTest-Group-960963314: creating
Apr 10 10:33:22 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-59a35a42-2879-4e5a-8078-3c49c2b4cca8 tempest-GroupSnapshotsTest-1554300411 None] Group tempest-GroupSnapshotsTest-Group-960963314: created successfully
Apr 10 10:33:22 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-59a35a42-2879-4e5a-8078-3c49c2b4cca8 tempest-GroupSnapshotsTest-1554300411 None] Create group completed successfully.
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "cinder-b7cb1d58-26b4-4e28-8e7d-b4d746a5356c-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-b7cb1d58-26b4-4e28-8e7d-b4d746a5356c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "cinder-quobyte-03e00188-af53-43a6-9cb8-191e800b868a" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-quobyte-03e00188-af53-43a6-9cb8-191e800b868a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "cinder-quobyte-b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-quobyte-b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Deleting offline snapshot b7cb1d58-26b4-4e28-8e7d-b4d746a5356c of volume 03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] snapshot_file for this snap is: volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[240477c6-6952-4219-8ae2-63abdfe57a3d]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:22 devstack sudo[84704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c
Apr 10 10:33:22 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:22 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 1 in 0.788s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 2G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 2G" returned: 0 in 0.048s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.443s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.208s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:23 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a671659b-47fc-47b3-8b1f-7d3b1c8de55c tempest-VolumesExtendTest-1665019589 None] Extend volume completed successfully.
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[7820b74e-f5e8-4e76-b4a9-a7f3a119e536]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:23 devstack sudo[84712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:23 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:23 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" returned: 0 in 0.576s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03e00188-af53-43a6-9cb8-191e800b868a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f28ac-bd5c-417b-95f5-a98428be32d6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:23 devstack sudo[84717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a
Apr 10 10:33:23 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:23 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 0 in 0.537s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:23 devstack sudo[84721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:23 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (4e3e0175-2c8e-4eab-ba50-8a82a46fb43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92635fc9-0f79-40da-a08c-ec607c1a99c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92635fc9-0f79-40da-a08c-ec607c1a99c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1725728738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78588a38-aa9a-4877-b194-439658619d88,host='devstack@QuobyteHD#QuobyteHD',id=1727d9b4-ebd9-4853-9769-74f1110554c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:24Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87facddf-58f8-4a3a-99f5-ea2aec9f5266),volume_type_id=87facddf-58f8-4a3a-99f5-ea2aec9f5266)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f17113f-11b9-4ec6-9684-182242018a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f17113f-11b9-4ec6-9684-182242018a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a08380-a9a5-4474-99b2-9dc6126892e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a08380-a9a5-4474-99b2-9dc6126892e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1727d9b4-ebd9-4853-9769-74f1110554c0', 'volume_name': 'volume-1727d9b4-ebd9-4853-9769-74f1110554c0', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3872aa2d-46d5-4fbe-8b93-407eadf60084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3872aa2d-46d5-4fbe-8b93-407eadf60084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951bd3fe-5e98-4d6a-bc6e-1b34d2dc0c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:24 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Volume 1727d9b4-ebd9-4853-9769-74f1110554c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1727d9b4-ebd9-4853-9769-74f1110554c0', 'volume_size': 1}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Acquiring lock "cinder-791fb18b-883c-43e9-9234-baa3e29310b9-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Lock "cinder-791fb18b-883c-43e9-9234-baa3e29310b9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Acquiring lock "cinder-quobyte-791fb18b-883c-43e9-9234-baa3e29310b9" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-791fb18b-883c-43e9-9234-baa3e29310b9" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:24 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a" returned: 0 in 0.810s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[2325d5c0-c56f-4cd0-b064-729e79c2ce19]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:24 devstack sudo[84729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c
Apr 10 10:33:24 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:24 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 1 in 0.603s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.177s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:24 devstack sudo[84730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:24 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78588a38-aa9a-4877-b194-439658619d88,created_at=2026-04-10T08:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1725728738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78588a38-aa9a-4877-b194-439658619d88,host='devstack@QuobyteHD#QuobyteHD',id=1727d9b4-ebd9-4853-9769-74f1110554c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:24Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87facddf-58f8-4a3a-99f5-ea2aec9f5266),volume_type_id=87facddf-58f8-4a3a-99f5-ea2aec9f5266)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Creating volume 1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:24 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:24 devstack sudo[84733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 1073741824
Apr 10 10:33:24 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98', 'name': 'volume-cba72461-95cf-4cc7-8a9d-3931e210119c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '412bbb7b-608d-4e20-928b-bca3271f4489', 'enforce_multipath': True} {{(pid=81969) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 10 10:33:24 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-bb7c7314-0cf9-4c47-9973-efbab62145fd req-babd48dd-0aa9-43f5-a7b2-aaa4eb60e0bc tempest-ServerBootFromVolumeStableRescueTest-147161644 None] attachment_update completed successfully.
Apr 10 10:33:24 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" returned: 0 in 0.507s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:24 devstack sudo[84741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c
Apr 10 10:33:24 devstack sudo[84741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:24 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 0 in 0.623s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:24 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 1073741824" returned: 0 in 0.592s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:24 devstack sudo[84745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:24 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:24 devstack sudo[84747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0
Apr 10 10:33:24 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:25 devstack sudo[84741]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a.b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" returned: 0 in 0.478s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-quobyte-b7cb1d58-26b4-4e28-8e7d-b4d746a5356c" released by "_delete_snapshot" :: held 2.450s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-quobyte-03e00188-af53-43a6-9cb8-191e800b868a" released by "delete_snapshot" :: held 2.468s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Created reservations ['b540ea63-3c45-4a36-9f19-4b5f67a3c56d', '18c4e9e8-54ef-45c0-8538-77e6009ab6ec', 'd86393f7-d3d9-471f-8e0d-472001307853', '65afafbc-3ce5-4908-abf4-83033be081e5'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:25 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Delete snapshot completed successfully.
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b700aeb7-cc4a-4e63-965a-6eade736838b tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-b7cb1d58-26b4-4e28-8e7d-b4d746a5356c-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:25 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 1 in 0.601s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:25 devstack sudo[84755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9
Apr 10 10:33:25 devstack sudo[84755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:25 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0" returned: 0 in 0.652s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951bd3fe-5e98-4d6a-bc6e-1b34d2dc0c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1727d9b4-ebd9-4853-9769-74f1110554c0', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7eb36e1-7846-4c53-9d01-9ee7f973cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:25 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Volume volume-1727d9b4-ebd9-4853-9769-74f1110554c0 (1727d9b4-ebd9-4853-9769-74f1110554c0): created successfully
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7eb36e1-7846-4c53-9d01-9ee7f973cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (4e3e0175-2c8e-4eab-ba50-8a82a46fb43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:25 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5c2a2d17-b70c-430b-80f5-760989df5f1f tempest-GroupSnapshotsTest-1554300411 None] Created volume successfully.
Apr 10 10:33:25 devstack sudo[84755]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-791fb18b-883c-43e9-9234-baa3e29310b9" returned: 0 in 0.553s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-791fb18b-883c-43e9-9234-baa3e29310b9" released by "delete_volume" :: held 1.834s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "cinder-03e00188-af53-43a6-9cb8-191e800b868a-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-03e00188-af53-43a6-9cb8-191e800b868a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Created reservations ['96265b1d-5db6-46de-b7e8-43e39a4f03b4', 'bad86c3e-8dc2-4439-a15e-857901efb950', 'a3ff3989-5377-4b7c-bd4a-a2c47dfc271a', '90d205ed-d62c-4872-819e-b5f47c36405c'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "cinder-quobyte-03e00188-af53-43a6-9cb8-191e800b868a" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-quobyte-03e00188-af53-43a6-9cb8-191e800b868a" acquired by "delete_volume" :: waited 0.046s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[928526e0-bafc-4de7-955c-dd7e2d36c9b6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:26 devstack sudo[84760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:26 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:26 devstack sudo[84761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a
Apr 10 10:33:26 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (e838b858-6b05-4d89-9201-556daef05047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8772e76e-0784-458c-9469-18b256963ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8772e76e-0784-458c-9469-18b256963ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131201240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78588a38-aa9a-4877-b194-439658619d88,host='devstack@QuobyteHD#QuobyteHD',id=9410a67c-844b-43d6-846e-f7c772ff312f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:27Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87facddf-58f8-4a3a-99f5-ea2aec9f5266),volume_type_id=87facddf-58f8-4a3a-99f5-ea2aec9f5266)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e14fc02-d44f-4ce8-8f41-1f8258adebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e14fc02-d44f-4ce8-8f41-1f8258adebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2b21f0-b430-4977-b059-c93a3efe174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2b21f0-b430-4977-b059-c93a3efe174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9410a67c-844b-43d6-846e-f7c772ff312f', 'volume_name': 'volume-9410a67c-844b-43d6-846e-f7c772ff312f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a8d768-f7c0-4820-978a-bb9c08e65afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a8d768-f7c0-4820-978a-bb9c08e65afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec23ac7c-6df1-4966-bd3f-17b95787737c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Volume 9410a67c-844b-43d6-846e-f7c772ff312f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9410a67c-844b-43d6-846e-f7c772ff312f', 'volume_size': 1}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78588a38-aa9a-4877-b194-439658619d88,created_at=2026-04-10T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131201240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78588a38-aa9a-4877-b194-439658619d88,host='devstack@QuobyteHD#QuobyteHD',id=9410a67c-844b-43d6-846e-f7c772ff312f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:27Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87facddf-58f8-4a3a-99f5-ea2aec9f5266),volume_type_id=87facddf-58f8-4a3a-99f5-ea2aec9f5266)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Creating volume 9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:26 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:26 devstack sudo[84765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f 1073741824
Apr 10 10:33:26 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:26 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Flow 'volume_create_manager' (e957312c-1211-4c83-a9ad-63617b5b2928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500bdd3c-59c3-491e-8fbd-7d4c2ed52f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.805s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500bdd3c-59c3-491e-8fbd-7d4c2ed52f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1644896142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8d8ed4-9cad-4510-9084-efaec42e40dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587d53ff9bf246e0822796a372108d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:27Z,use_quota=True,user_id='942a01883cec415787b4e8a32c8ae67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7786dd-40c1-4944-b2a4-50cbe18da221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7786dd-40c1-4944-b2a4-50cbe18da221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b946772-4658-4194-80ce-89873a663465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b946772-4658-4194-80ce-89873a663465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8d8ed4-9cad-4510-9084-efaec42e40dd', 'volume_name': 'volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48c42d7-df85-4fc9-9b8a-0a08c97b1373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48c42d7-df85-4fc9-9b8a-0a08c97b1373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbfa74b-94e3-4134-a371-b42c6ce4a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:26 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Volume cf8d8ed4-9cad-4510-9084-efaec42e40dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd', 'volume_size': 1}
Apr 10 10:33:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:26 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Deleted volume successfully.
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e41c9ab8-2879-481e-a24e-a09cc506d81c tempest-VolumesExtendTest-1665019589 None] Lock "cinder-791fb18b-883c-43e9-9234-baa3e29310b9-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:27 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a" returned: 0 in 0.870s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:27 devstack sudo[84770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a
Apr 10 10:33:27 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:27 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f 1073741824" returned: 0 in 0.691s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:27 devstack sudo[84779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f
Apr 10 10:33:27 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:27 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-03e00188-af53-43a6-9cb8-191e800b868a" returned: 0 in 0.580s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-quobyte-03e00188-af53-43a6-9cb8-191e800b868a" released by "delete_volume" :: held 1.507s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Created reservations ['2b417545-6d8a-4747-987a-c1d40e87bef7', 'b4c11d10-78d6-4665-9117-4e4fcd4e39be', '6e5c2179-ed53-4f73-bc05-9a00bd051b70', '238942da-14c2-4542-b923-0e6617287d7a'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:27 devstack sudo[84781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:27 devstack sudo[84781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:28 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f" returned: 0 in 0.556s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1644896142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8d8ed4-9cad-4510-9084-efaec42e40dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587d53ff9bf246e0822796a372108d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:27Z,use_quota=True,user_id='942a01883cec415787b4e8a32c8ae67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Creating volume cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:28 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec23ac7c-6df1-4966-bd3f-17b95787737c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9410a67c-844b-43d6-846e-f7c772ff312f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30e2a3a-d31c-48fe-9f81-148e8434ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:28 devstack sudo[84784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd 1073741824
Apr 10 10:33:28 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:28 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Volume volume-9410a67c-844b-43d6-846e-f7c772ff312f (9410a67c-844b-43d6-846e-f7c772ff312f): created successfully
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30e2a3a-d31c-48fe-9f81-148e8434ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (e838b858-6b05-4d89-9201-556daef05047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ea847be4-b506-4010-b0a0-299a127829d8 tempest-GroupSnapshotsTest-1554300411 None] Created volume successfully.
Apr 10 10:33:28 devstack sudo[84781]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.516s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Deleted volume successfully.
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-af33c7fb-870b-4b09-8ae8-16e61686d195 tempest-SnapshotMetadataTestJSON-670118891 None] Lock "cinder-03e00188-af53-43a6-9cb8-191e800b868a-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:28 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd 1073741824" returned: 0 in 0.783s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:28 devstack sudo[84812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd
Apr 10 10:33:28 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-89222968-f39b-40bf-9dbc-b8906ff899fe tempest-GroupSnapshotsTest-1554300411 None] Update group completed successfully.
Apr 10 10:33:29 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd" returned: 0 in 0.779s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbfa74b-94e3-4134-a371-b42c6ce4a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3145aded-fe96-44dc-bb01-319d69629e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:29 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Volume volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd (cf8d8ed4-9cad-4510-9084-efaec42e40dd): created successfully
Apr 10 10:33:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3145aded-fe96-44dc-bb01-319d69629e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Flow 'volume_create_manager' (e957312c-1211-4c83-a9ad-63617b5b2928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-706e2f80-9641-42f6-83bd-13b7ebc6ab58 tempest-VolumesExtendTest-1665019589 None] Created volume successfully.
Apr 10 10:33:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:30 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Creating offline snapshot 1f41264a-9562-452c-8561-cfd0915139a4 of volume cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:33:30 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa7ca1e-7baa-4095-805e-100d1dbc627b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:30 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-407e3822-2565-4999-8e05-28d04b1a62cd tempest-GroupSnapshotsTest-1554300411 None] Update group completed successfully.
Apr 10 10:33:30 devstack sudo[84818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd
Apr 10 10:33:30 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:31 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd" returned: 0 in 0.902s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:31 devstack sudo[84823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 1G
Apr 10 10:33:31 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-47753a58-4cf7-4385-bd04-fcd5cb9d2de6 tempest-GroupSnapshotsTest-1554300411 None] Update group completed successfully.
Apr 10 10:33:32 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 1G" returned: 0 in 0.907s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:32 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4
Apr 10 10:33:32 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:32 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-42fc6dde-f8d6-4f98-88e9-304a7ffa834a tempest-GroupSnapshotsTest-1554300411 None] Update group completed successfully.
Apr 10 10:33:33 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4" returned: 0 in 0.725s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:33 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 is being set with open permissions: ugo+rw
Apr 10 10:33:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:33 devstack sudo[84833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4
Apr 10 10:33:33 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:33 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4" returned: 0 in 0.598s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:33 devstack sudo[84836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.info
Apr 10 10:33:33 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:34 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.info" returned: 0 in 0.710s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:34 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.info is being set with open permissions: ugo+rw
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:34 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] GroupSnapshot ab61de09-7cef-4fc7-bea0-33f2ad87ddb1: creating.
Apr 10 10:33:34 devstack sudo[84839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.info
Apr 10 10:33:34 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Group snapshot ab61de09-7cef-4fc7-bea0-33f2ad87ddb1: creating. {{(pid=81969) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:34 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.info" returned: 0 in 0.498s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.435s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.436s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Creating offline snapshot 30fe6b6d-e268-4737-bb87-5ccc81c4f57c of volume 9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:33:34 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7c5045f0-4702-463f-92cc-e338b68aa8e5 tempest-VolumesExtendTest-1665019589 None] Create snapshot completed successfully
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff69d7e9-5d25-4dec-8bd9-09c348163c65]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:35 devstack sudo[84842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f
Apr 10 10:33:35 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:35 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f" returned: 0 in 0.657s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:35 devstack sudo[84847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c 1G
Apr 10 10:33:35 devstack sudo[84847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:36 devstack sudo[84847]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c 1G" returned: 0 in 0.735s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9410a67c-844b-43d6-846e-f7c772ff312f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:36 devstack sudo[84872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9410a67c-844b-43d6-846e-f7c772ff312f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c
Apr 10 10:33:36 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:36 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9410a67c-844b-43d6-846e-f7c772ff312f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c" returned: 0 in 0.567s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:36 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:33:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:36 devstack sudo[84878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c
Apr 10 10:33:36 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:37 devstack sudo[84881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:37 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:37 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c" returned: 0 in 0.691s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:UPDATE=161,cinder:SELECT=162,cinder:INSERT=43,cinder:DELETE=14 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:33:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:37 devstack sudo[84883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.info
Apr 10 10:33:37 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:38 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.853s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:38 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.info" returned: 0 in 0.707s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:38 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:38 devstack sudo[84905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.info
Apr 10 10:33:38 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:38 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.info" returned: 0 in 0.509s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.986s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Creating offline snapshot a6241d2e-2db9-48ef-bcad-e6782428df4f of volume 1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0c657-1ef5-4c83-be37-00cf3b3eba7f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:38 devstack sudo[84908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0
Apr 10 10:33:38 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:39 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0" returned: 0 in 0.613s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:39 devstack sudo[84915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f 1G
Apr 10 10:33:39 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:40 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f 1G" returned: 0 in 0.641s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1727d9b4-ebd9-4853-9769-74f1110554c0 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:40 devstack sudo[84921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1727d9b4-ebd9-4853-9769-74f1110554c0 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f
Apr 10 10:33:40 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:40 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1727d9b4-ebd9-4853-9769-74f1110554c0 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:40 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:33:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:40 devstack sudo[84926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f
Apr 10 10:33:40 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Flow 'volume_create_manager' (a5086345-2e1b-4f16-86fd-df22b3c44e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c482db3-0343-445f-9adc-b168720e59ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c482db3-0343-445f-9adc-b168720e59ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185530716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33c7859-abe5-4ee5-884a-c0b4b38f5a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a1d49d229d43db86bcea37ef970bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:41Z,use_quota=True,user_id='06a90a3a960c46c3b9f84b8796a181a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6353b4c1-d832-47d6-b7cf-5ac750fdf966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6353b4c1-d832-47d6-b7cf-5ac750fdf966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e8d698-69ac-4c0c-9537-cfc2662372bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:41 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e8d698-69ac-4c0c-9537-cfc2662372bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33c7859-abe5-4ee5-884a-c0b4b38f5a6e', 'volume_name': 'volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262a0ee-ccb0-4e60-b861-f9f116ff5f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262a0ee-ccb0-4e60-b861-f9f116ff5f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69661f1-da9b-42c3-9862-d69d289cbb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:41 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Volume b33c7859-abe5-4ee5-884a-c0b4b38f5a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e', 'volume_size': 1}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f" returned: 0 in 0.652s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:41 devstack sudo[84929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.info
Apr 10 10:33:41 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:41 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.info" returned: 0 in 0.423s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:41 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:33:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:41 devstack sudo[84932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.info
Apr 10 10:33:41 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:42 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.info" returned: 0 in 0.483s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.436s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.512s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:42 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3025f816-e8b8-4cc9-b17c-609f7f544393]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:42 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4b996c82-d2fd-41f8-904e-9359c7e0f192 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot ab61de09-7cef-4fc7-bea0-33f2ad87ddb1: created successfully
Apr 10 10:33:42 devstack sudo[84935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd
Apr 10 10:33:42 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:42 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] group_snapshot ab61de09-7cef-4fc7-bea0-33f2ad87ddb1: deleting
Apr 10 10:33:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] group_snapshot ab61de09-7cef-4fc7-bea0-33f2ad87ddb1: deleting {{(pid=81969) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 10 10:33:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-9410a67c-844b-43d6-846e-f7c772ff312f" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-9410a67c-844b-43d6-846e-f7c772ff312f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-30fe6b6d-e268-4737-bb87-5ccc81c4f57c" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-30fe6b6d-e268-4737-bb87-5ccc81c4f57c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Deleting offline snapshot 30fe6b6d-e268-4737-bb87-5ccc81c4f57c of volume 9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] snapshot_file for this snap is: volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f610471e-4215-4320-9f42-4b71154c5b4d]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:43 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd" returned: 0 in 0.831s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 2G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:43 devstack sudo[84964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c
Apr 10 10:33:43 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 2G" returned: 0 in 0.117s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.981s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.921s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185530716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33c7859-abe5-4ee5-884a-c0b4b38f5a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a1d49d229d43db86bcea37ef970bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:41Z,use_quota=True,user_id='06a90a3a960c46c3b9f84b8796a181a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Creating volume b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:43 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:43 devstack sudo[84969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e 1073741824
Apr 10 10:33:43 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:43 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ccf8b3c8-a918-415e-ae83-fe2994cc98d3 tempest-VolumesExtendTest-1665019589 None] Extend volume completed successfully.
Apr 10 10:33:43 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c" returned: 0 in 0.724s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9410a67c-844b-43d6-846e-f7c772ff312f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f1e58-6d28-43c5-81d1-90ea24bef7e5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:43 devstack sudo[84974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f
Apr 10 10:33:43 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:44 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e 1073741824" returned: 0 in 0.866s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:44 devstack sudo[84979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:33:44 devstack sudo[84979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:44 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f" returned: 0 in 0.718s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:44 devstack sudo[84984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c
Apr 10 10:33:44 devstack sudo[84984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Acquiring lock "cinder-1f41264a-9562-452c-8561-cfd0915139a4-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Lock "cinder-1f41264a-9562-452c-8561-cfd0915139a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Acquiring lock "cinder-quobyte-cf8d8ed4-9cad-4510-9084-efaec42e40dd" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-cf8d8ed4-9cad-4510-9084-efaec42e40dd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Acquiring lock "cinder-quobyte-1f41264a-9562-452c-8561-cfd0915139a4" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:44 devstack sudo[84979]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-1f41264a-9562-452c-8561-cfd0915139a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Deleting offline snapshot 1f41264a-9562-452c-8561-cfd0915139a4 of volume cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] snapshot_file for this snap is: volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.637s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b8375-97aa-4f00-88e8-01418c534baf]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69661f1-da9b-42c3-9862-d69d289cbb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4057ace-59b1-4050-aae5-ab66e7224325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:44 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Volume volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e (b33c7859-abe5-4ee5-884a-c0b4b38f5a6e): created successfully
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4057ace-59b1-4050-aae5-ab66e7224325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Flow 'volume_create_manager' (a5086345-2e1b-4f16-86fd-df22b3c44e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:44 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7dea5448-3785-442d-ad9a-349f5bc4bdd9 tempest-VolumesActionsTest-1554026035 None] Created volume successfully.
Apr 10 10:33:45 devstack sudo[84987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4
Apr 10 10:33:45 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:45 devstack sudo[84984]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c" returned: 0 in 0.751s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:45 devstack sudo[84992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c
Apr 10 10:33:45 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:45 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4" returned: 0 in 0.863s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0f4966-c79c-43c1-a6b7-2b95b3dea52f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:45 devstack sudo[84997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd
Apr 10 10:33:45 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:45 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f.30fe6b6d-e268-4737-bb87-5ccc81c4f57c" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-30fe6b6d-e268-4737-bb87-5ccc81c4f57c" released by "_delete_snapshot" :: held 2.914s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-9410a67c-844b-43d6-846e-f7c772ff312f" released by "delete_snapshot" :: held 2.934s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-1727d9b4-ebd9-4853-9769-74f1110554c0" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-1727d9b4-ebd9-4853-9769-74f1110554c0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-a6241d2e-2db9-48ef-bcad-e6782428df4f" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-a6241d2e-2db9-48ef-bcad-e6782428df4f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Deleting offline snapshot a6241d2e-2db9-48ef-bcad-e6782428df4f of volume 1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:33:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] snapshot_file for this snap is: volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:33:46 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0b23af-0c12-49e8-a5ef-25753cd397fa]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:46 devstack sudo[85000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f
Apr 10 10:33:46 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:46 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd" returned: 0 in 1.010s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:46 devstack sudo[85005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4
Apr 10 10:33:46 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:47 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f" returned: 0 in 1.148s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1727d9b4-ebd9-4853-9769-74f1110554c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:33:47 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[964e0d0b-ff3c-4b50-aad4-e3a00741551f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:47 devstack sudo[85011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0
Apr 10 10:33:47 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:47 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4" returned: 0 in 1.053s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:47 devstack sudo[85017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4
Apr 10 10:33:47 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:48 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0" returned: 0 in 0.820s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:48 devstack sudo[85022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f
Apr 10 10:33:48 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:48 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd.1f41264a-9562-452c-8561-cfd0915139a4" returned: 0 in 0.661s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-1f41264a-9562-452c-8561-cfd0915139a4" released by "_delete_snapshot" :: held 3.698s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-cf8d8ed4-9cad-4510-9084-efaec42e40dd" released by "delete_snapshot" :: held 3.728s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Created reservations ['b2b2dbe2-7452-44e7-8c56-bdadf4f050f3', '0f53637a-a7cc-46ba-88b4-b221c5193e2b', '2a51efd4-b394-4a23-88f2-8b1cc85d857f', '535b32c4-bb16-4b9d-9f0e-11046ffb9b15'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Delete snapshot completed successfully.
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8309913-ec88-43be-8611-fa6bcfa8494a tempest-VolumesExtendTest-1665019589 None] Lock "cinder-1f41264a-9562-452c-8561-cfd0915139a4-delete_snapshot" released by "delete_snapshot" :: held 3.862s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:48 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f" returned: 0 in 0.836s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:48 devstack sudo[85057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f
Apr 10 10:33:48 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Acquiring lock "cinder-cf8d8ed4-9cad-4510-9084-efaec42e40dd-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Lock "cinder-cf8d8ed4-9cad-4510-9084-efaec42e40dd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Acquiring lock "cinder-quobyte-cf8d8ed4-9cad-4510-9084-efaec42e40dd" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-cf8d8ed4-9cad-4510-9084-efaec42e40dd" acquired by "delete_volume" :: waited 0.023s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[7948b195-1eff-407a-a429-ebef481bb997]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:49 devstack sudo[85060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd
Apr 10 10:33:49 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:49 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0.a6241d2e-2db9-48ef-bcad-e6782428df4f" returned: 0 in 0.669s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-a6241d2e-2db9-48ef-bcad-e6782428df4f" released by "_delete_snapshot" :: held 3.581s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-1727d9b4-ebd9-4853-9769-74f1110554c0" released by "delete_snapshot" :: held 3.610s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:49 devstack cinder-volume[81969]: WARNING cinder.quota [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-652252584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-652252584, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:33:49 devstack cinder-volume[81969]: WARNING cinder.quota [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-652252584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-652252584, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['b002d99b-d62d-45f1-b470-64cfa1f7142d', 'b8189867-d263-4633-8625-3d771ca82ceb', 'd93f0e27-c073-4dad-9e65-b83a28b280af', '6a596bc3-254d-415e-a432-1952d5313667'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:49 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['53915f60-c8be-4c35-ac20-525dc7865b1f', 'e27c2abb-f3b2-42e7-9237-245947832c36', 'f02e7e99-60fe-4c9f-b705-a6273ba3c184', '161e8cf5-f2f8-41f4-b85f-8681bc0871f8'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:50 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-23d1efe9-0212-4ee2-8073-6928ea92580b tempest-GroupSnapshotsTest-1554300411 None] group_snapshot ab61de09-7cef-4fc7-bea0-33f2ad87ddb1: deleted successfully
Apr 10 10:33:50 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd" returned: 0 in 0.961s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:50 devstack sudo[85087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd
Apr 10 10:33:50 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:50 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf8d8ed4-9cad-4510-9084-efaec42e40dd" returned: 0 in 0.741s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Lock "cinder-quobyte-cf8d8ed4-9cad-4510-9084-efaec42e40dd" released by "delete_volume" :: held 1.748s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:50 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Created reservations ['8601c582-119b-4846-b50f-cd666c58e129', '613d2c5f-b3f5-4009-af54-668c3e651ba4', 'a52b79e7-9a8b-4616-b151-06569abf9f88', 'f2c67734-c7d2-4984-838e-f2c4d6756d18'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-1727d9b4-ebd9-4853-9769-74f1110554c0" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-1727d9b4-ebd9-4853-9769-74f1110554c0" acquired by "delete_volume" :: waited 0.058s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:51 devstack sudo[85091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:51 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[50371587-fa57-49c7-a388-61c73cc3ae17]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:51 devstack sudo[85093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0
Apr 10 10:33:51 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:51 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.857s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:51 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Deleted volume successfully.
Apr 10 10:33:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e12cff95-386f-4cfa-b7c8-d3b0a6f03779 tempest-VolumesExtendTest-1665019589 None] Lock "cinder-cf8d8ed4-9cad-4510-9084-efaec42e40dd-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:52 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0" returned: 0 in 1.265s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:52 devstack sudo[85099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0
Apr 10 10:33:52 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:53 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1727d9b4-ebd9-4853-9769-74f1110554c0" returned: 0 in 0.780s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-1727d9b4-ebd9-4853-9769-74f1110554c0" released by "delete_volume" :: held 2.151s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-9410a67c-844b-43d6-846e-f7c772ff312f" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-9410a67c-844b-43d6-846e-f7c772ff312f" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:53 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10eb1f6-17e7-4fa4-81a2-98f5621c3b2b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:53 devstack sudo[85124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f
Apr 10 10:33:53 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:54 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f" returned: 0 in 0.948s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:54 devstack sudo[85131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f
Apr 10 10:33:54 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Flow 'volume_create_manager' (899a298a-d303-40b1-8235-6cd68c802d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a96fb4a-17ba-45c7-ab3d-b11166573859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a96fb4a-17ba-45c7-ab3d-b11166573859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1853382839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf606ff1-ef87-4887-b920-d51d67be0ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ea9698ef694b49972d2b2a1cf11002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:54Z,use_quota=True,user_id='20f9050c52fa4a248ab03863577d06b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80c6ac2-58f6-48fd-b5e9-b03c29b20fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80c6ac2-58f6-48fd-b5e9-b03c29b20fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ce7260-0bce-4dc7-9abf-dbbb28aed695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ce7260-0bce-4dc7-9abf-dbbb28aed695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf606ff1-ef87-4887-b920-d51d67be0ae9', 'volume_name': 'volume-bf606ff1-ef87-4887-b920-d51d67be0ae9', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78924554-cd26-454f-b297-5dbac4585ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78924554-cd26-454f-b297-5dbac4585ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f52819-a943-46b8-aedf-da1fa7db9b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Volume bf606ff1-ef87-4887-b920-d51d67be0ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf606ff1-ef87-4887-b920-d51d67be0ae9', 'volume_size': 1}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1853382839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf606ff1-ef87-4887-b920-d51d67be0ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ea9698ef694b49972d2b2a1cf11002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:54Z,use_quota=True,user_id='20f9050c52fa4a248ab03863577d06b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Creating volume bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:33:54 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:33:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:54 devstack sudo[85138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 1073741824
Apr 10 10:33:54 devstack sudo[85138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:55 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9410a67c-844b-43d6-846e-f7c772ff312f" returned: 0 in 1.033s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-9410a67c-844b-43d6-846e-f7c772ff312f" released by "delete_volume" :: held 2.037s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['25e069d3-bd37-49d8-80c4-c9104b4bd7e7'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:55 devstack cinder-volume[81969]: WARNING cinder.quota [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-652252584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-652252584, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['eaa44da7-40b2-4d6c-9b65-d134e0b24037', '34ec7b32-4357-45f5-81c9-6f42778b5ef0', 'f60324b5-fb0a-482c-9e45-e650d7703238', '230ec655-4283-4f44-9e9c-b798eb4e9ce7'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:55 devstack sudo[85138]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 1073741824" returned: 0 in 0.937s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['6869fabe-c6b8-4a73-b656-3834dcaff57f', '8d7df800-3900-49a2-9202-10ccbaec7d6a', 'cba69e85-adbc-4e25-970a-3f25bb8acb28', '5617ab35-889d-4e0c-9485-a338dd03e473'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:55 devstack sudo[85169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9
Apr 10 10:33:55 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:55 devstack sudo[85171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:55 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:56 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f52819-a943-46b8-aedf-da1fa7db9b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf606ff1-ef87-4887-b920-d51d67be0ae9', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e8679-6d1d-4246-ad99-c09b7f837f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:56 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Volume volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 (bf606ff1-ef87-4887-b920-d51d67be0ae9): created successfully
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e8679-6d1d-4246-ad99-c09b7f837f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Flow 'volume_create_manager' (899a298a-d303-40b1-8235-6cd68c802d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-593bf287-b28d-4056-9d54-e1004ca24818 tempest-VolumesSnapshotListTestJSON-1256935369 None] Created volume successfully.
Apr 10 10:33:56 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.532s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-484743fc-0e90-4346-8a70-c4ad7351f476 tempest-GroupSnapshotsTest-1554300411 None] Delete group completed successfully.
Apr 10 10:33:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-3f27bec7-dfd5-44a9-8a05-2f80f0eeeee2 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Terminate volume connection completed successfully.
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-3f27bec7-dfd5-44a9-8a05-2f80f0eeeee2 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Deleting attachment 412bbb7b-608d-4e20-928b-bca3271f4489. {{(pid=81969) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Creating offline snapshot 7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a of volume bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[66baf2b3-aee3-44f9-acca-341aa1597052]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:56 devstack sudo[85209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9
Apr 10 10:33:56 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "cinder-cba72461-95cf-4cc7-8a9d-3931e210119c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-cba72461-95cf-4cc7-8a9d-3931e210119c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "cinder-quobyte-cba72461-95cf-4cc7-8a9d-3931e210119c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-quobyte-cba72461-95cf-4cc7-8a9d-3931e210119c" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5402182-eaf0-4fa9-8348-df0d3aa1e554]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:57 devstack sudo[85211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:57 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4225119f-610a-4ac5-9aee-bd93aa4fa408 tempest-GroupSnapshotsTest-1554300411 None] Group tempest-GroupSnapshotsTest-Group-1626446398: creating
Apr 10 10:33:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4225119f-610a-4ac5-9aee-bd93aa4fa408 tempest-GroupSnapshotsTest-1554300411 None] Group tempest-GroupSnapshotsTest-Group-1626446398: created successfully
Apr 10 10:33:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4225119f-610a-4ac5-9aee-bd93aa4fa408 tempest-GroupSnapshotsTest-1554300411 None] Create group completed successfully.
Apr 10 10:33:57 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9" returned: 0 in 0.793s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:57 devstack sudo[85218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a 1G
Apr 10 10:33:57 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:57 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:57 devstack sudo[85220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:57 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:58 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a 1G" returned: 0 in 0.537s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:58 devstack sudo[85227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a
Apr 10 10:33:58 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:58 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 1 in 0.541s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:58 devstack sudo[85233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c
Apr 10 10:33:58 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (9a47a18e-e27b-44df-8e00-dfdec397838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce8aea9-3daf-4bdd-89ca-48369f146c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:58 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce8aea9-3daf-4bdd-89ca-48369f146c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494766280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6707fc2-70f0-4ee2-bd29-73fa0ebf7d3a,host='devstack@QuobyteHD#QuobyteHD',id=58199898-29dd-475d-a947-1a28dce821f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:59Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bece7cc-3554-4e3d-8ca3-56f66b12ef87),volume_type_id=7bece7cc-3554-4e3d-8ca3-56f66b12ef87)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9670c-e678-4398-b894-9c1f0d62fe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9670c-e678-4398-b894-9c1f0d62fe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1698a152-9cb6-4750-a71c-3472af9a5bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1698a152-9cb6-4750-a71c-3472af9a5bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58199898-29dd-475d-a947-1a28dce821f7', 'volume_name': 'volume-58199898-29dd-475d-a947-1a28dce821f7', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658a2044-c248-4c74-9e17-c811211c78e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658a2044-c248-4c74-9e17-c811211c78e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e45629-52dc-4ef1-aace-47db0aa9028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:33:58 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Volume 58199898-29dd-475d-a947-1a28dce821f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58199898-29dd-475d-a947-1a28dce821f7', 'volume_size': 1}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" returned: 0 in 0.645s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:58 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a is being set with open permissions: ugo+rw
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:58 devstack sudo[85239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a
Apr 10 10:33:58 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:58 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cba72461-95cf-4cc7-8a9d-3931e210119c" returned: 0 in 0.630s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-quobyte-cba72461-95cf-4cc7-8a9d-3931e210119c" released by "delete_volume" :: held 1.807s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.quota [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Created reservations ['6a143d24-8804-4486-9d59-f9290a2c48df', '8124dd9b-4fdd-4bb2-a9f8-5e47bcf6a858', '8a62708b-d33a-456f-89c6-da44a2b0534a', '800ddc36-0d59-424c-a317-f8d0575bf46f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:33:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:59 devstack sudo[85241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:33:59 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:59 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" returned: 0 in 0.465s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:59 devstack sudo[85244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.info
Apr 10 10:33:59 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:33:59 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.477s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:59 devstack cinder-volume[81969]: DEBUG cinder.manager [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:33:59 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Deleted volume successfully.
Apr 10 10:33:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-5a679853-6c41-4f3c-abb3-7c4674e4aa69 req-4ebecd2c-7d7b-4d22-a0a7-f7e89d1b45ba tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-cba72461-95cf-4cc7-8a9d-3931e210119c-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:33:59 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root
Apr 10 10:33:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.info" returned: 0 in 0.536s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:33:59 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.info is being set with open permissions: ugo+rw
Apr 10 10:33:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:33:59 devstack sudo[85268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.info
Apr 10 10:33:59 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:00 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.info" returned: 0 in 0.723s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.778s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d6707fc2-70f0-4ee2-bd29-73fa0ebf7d3a,created_at=2026-04-10T08:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494766280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6707fc2-70f0-4ee2-bd29-73fa0ebf7d3a,host='devstack@QuobyteHD#QuobyteHD',id=58199898-29dd-475d-a947-1a28dce821f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a831442c9d8a43a1beb8585b835930d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:59Z,use_quota=True,user_id='b2d52c9ef33f4d22a160ec683b5c1107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bece7cc-3554-4e3d-8ca3-56f66b12ef87),volume_type_id=7bece7cc-3554-4e3d-8ca3-56f66b12ef87)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Creating volume 58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:34:00 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:34:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:00 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-6b4c366b-dcc8-48ae-b292-5c1f2a6470dd tempest-VolumesSnapshotListTestJSON-1256935369 None] Create snapshot completed successfully
Apr 10 10:34:00 devstack sudo[85277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 1073741824
Apr 10 10:34:00 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:01 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 1073741824" returned: 0 in 0.777s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:01 devstack sudo[85284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7
Apr 10 10:34:01 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:02 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7" returned: 0 in 0.835s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.128s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Creating offline snapshot 2399cdac-8f57-49cf-9201-9279f9741e5d of volume bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e45629-52dc-4ef1-aace-47db0aa9028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58199898-29dd-475d-a947-1a28dce821f7', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77714dfe-a26e-4c21-aa17-65c24344f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[7546790d-4d6e-43b7-b74e-a059cf593c2b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:02 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Volume volume-58199898-29dd-475d-a947-1a28dce821f7 (58199898-29dd-475d-a947-1a28dce821f7): created successfully
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77714dfe-a26e-4c21-aa17-65c24344f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Flow 'volume_create_manager' (9a47a18e-e27b-44df-8e00-dfdec397838b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:02 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-41156b48-e232-473b-afc0-0e7f55cbb7b3 tempest-GroupSnapshotsTest-1554300411 None] Created volume successfully.
Apr 10 10:34:02 devstack sudo[85312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a
Apr 10 10:34:02 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:03 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" returned: 0 in 0.679s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf606ff1-ef87-4887-b920-d51d67be0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c47a5a49-07ab-4333-bf7b-1ace7066fc79 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" by "attach_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:03 devstack sudo[85317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d 1G
Apr 10 10:34:03 devstack sudo[85317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c47a5a49-07ab-4333-bf7b-1ace7066fc79 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" acquired by "attach_volume" :: waited 0.029s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c47a5a49-07ab-4333-bf7b-1ace7066fc79 tempest-VolumesActionsTest-1554026035 None] Attaching volume b33c7859-abe5-4ee5-884a-c0b4b38f5a6e to instance 352bb3b0-b3f3-4998-92e4-6a63595bb740 at mountpoint /dev/vdb on host None.
Apr 10 10:34:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c47a5a49-07ab-4333-bf7b-1ace7066fc79 tempest-VolumesActionsTest-1554026035 None] Attach volume completed successfully.
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c47a5a49-07ab-4333-bf7b-1ace7066fc79 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" released by "attach_volume" :: held 0.113s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] GroupSnapshot dec58bcc-80a6-4c65-8963-e4b14d67d7fc: creating.
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Group snapshot dec58bcc-80a6-4c65-8963-e4b14d67d7fc: creating. {{(pid=81969) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f30edcd9-c57d-413c-b978-d02a09ae90f0 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-detach_volume" by "detach_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f30edcd9-c57d-413c-b978-d02a09ae90f0 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f30edcd9-c57d-413c-b978-d02a09ae90f0 tempest-VolumesActionsTest-1554026035 None] Detaching volume b33c7859-abe5-4ee5-884a-c0b4b38f5a6e from instance 352bb3b0-b3f3-4998-92e4-6a63595bb740.
Apr 10 10:34:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f30edcd9-c57d-413c-b978-d02a09ae90f0 tempest-VolumesActionsTest-1554026035 None] Detach volume completed successfully.
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f30edcd9-c57d-413c-b978-d02a09ae90f0 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:03 devstack sudo[85317]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d 1G" returned: 0 in 0.760s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:03 devstack sudo[85323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d
Apr 10 10:34:03 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:04 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d" returned: 0 in 0.583s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:04 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d is being set with open permissions: ugo+rw
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:04 devstack sudo[85328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d
Apr 10 10:34:04 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:04 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.656s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:04 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1a9fa2a1-4b36-4cdb-bd7b-1cf1072c479f tempest-VolumesSnapshotListTestJSON-1256935369 None] Create snapshot completed successfully
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Creating offline snapshot 5d667186-9fb5-4353-9972-6a3f7f2e2029 of volume 58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0291ac6-0267-47a7-ba88-56d433c2de1f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:05 devstack sudo[85331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7
Apr 10 10:34:05 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:05 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7" returned: 0 in 0.712s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:05 devstack sudo[85358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 1G
Apr 10 10:34:05 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:06 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 1G" returned: 0 in 0.636s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58199898-29dd-475d-a947-1a28dce821f7 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:06 devstack sudo[85364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58199898-29dd-475d-a947-1a28dce821f7 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029
Apr 10 10:34:06 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:06 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58199898-29dd-475d-a947-1a28dce821f7 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:06 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:34:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:06 devstack sudo[85369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029
Apr 10 10:34:06 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:07 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029" returned: 0 in 0.590s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:07 devstack sudo[85373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.info
Apr 10 10:34:07 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:08 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.info" returned: 0 in 0.481s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:08 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:08 devstack sudo[85376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.info
Apr 10 10:34:08 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:08 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.info" returned: 0 in 0.643s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.706s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.079s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Creating offline snapshot c3514cb5-7311-49ae-8d32-6f114e70ae8d of volume bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bcfcba-346c-4707-a697-f8a18dc6d938]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:08 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ebb50532-33c6-44f2-b816-5374c7b46cd6 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot dec58bcc-80a6-4c65-8963-e4b14d67d7fc: created successfully
Apr 10 10:34:08 devstack sudo[85401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d
Apr 10 10:34:08 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:09 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d" returned: 0 in 0.598s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf606ff1-ef87-4887-b920-d51d67be0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:09 devstack sudo[85408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d 1G
Apr 10 10:34:09 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:09 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot dec58bcc-80a6-4c65-8963-e4b14d67d7fc: deleting
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot dec58bcc-80a6-4c65-8963-e4b14d67d7fc: deleting {{(pid=81969) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-58199898-29dd-475d-a947-1a28dce821f7" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-58199898-29dd-475d-a947-1a28dce821f7" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-5d667186-9fb5-4353-9972-6a3f7f2e2029" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-5d667186-9fb5-4353-9972-6a3f7f2e2029" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Deleting offline snapshot 5d667186-9fb5-4353-9972-6a3f7f2e2029 of volume 58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] snapshot_file for this snap is: volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a8dbe-e20a-4888-8e52-353575a5c0e3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:09 devstack sudo[85413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029
Apr 10 10:34:09 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:10 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d 1G" returned: 0 in 0.846s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:10 devstack sudo[85417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d
Apr 10 10:34:10 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:10 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029" returned: 0 in 0.839s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58199898-29dd-475d-a947-1a28dce821f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[55350ffe-7061-4bb2-9c0f-21364c6fb1c4]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:10 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d" returned: 0 in 0.575s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:10 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d is being set with open permissions: ugo+rw
Apr 10 10:34:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:10 devstack sudo[85425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7
Apr 10 10:34:10 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:10 devstack sudo[85426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d
Apr 10 10:34:10 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:11 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-255d669f-74ca-4864-86e9-08bec6eeea49 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Terminate volume connection completed successfully.
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-255d669f-74ca-4864-86e9-08bec6eeea49 tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Deleting attachment 3cdd5578-9096-4a60-bb32-eef2b20332ae. {{(pid=81969) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 10 10:34:11 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7" returned: 0 in 0.578s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:11 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d" returned: 0 in 0.530s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:11 devstack sudo[85433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029
Apr 10 10:34:11 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:11 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-50b2793d-efc9-4bc8-ae17-09074b3c19d6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Create snapshot completed successfully
Apr 10 10:34:11 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029" returned: 0 in 0.543s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:11 devstack sudo[85438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029
Apr 10 10:34:11 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "cinder-87d1427d-86f8-4717-8fd7-dc007d3ed41c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-87d1427d-86f8-4717-8fd7-dc007d3ed41c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "cinder-quobyte-87d1427d-86f8-4717-8fd7-dc007d3ed41c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-quobyte-87d1427d-86f8-4717-8fd7-dc007d3ed41c" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f8dec8-4700-45a4-b2d4-6cb71a144fc3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:12 devstack sudo[85440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c
Apr 10 10:34:12 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:12 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7.5d667186-9fb5-4353-9972-6a3f7f2e2029" returned: 0 in 0.585s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-5d667186-9fb5-4353-9972-6a3f7f2e2029" released by "_delete_snapshot" :: held 2.664s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-58199898-29dd-475d-a947-1a28dce821f7" released by "delete_snapshot" :: held 2.683s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:12 devstack cinder-volume[81969]: WARNING cinder.quota [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-323647211 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-323647211, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:34:12 devstack cinder-volume[81969]: WARNING cinder.quota [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-323647211 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-323647211, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['c44d0396-b39f-46fa-8125-10ba43a61837', '42b71616-a049-4ed8-88ff-826903bfac3a', 'aaa743bf-9fd3-4214-a15d-08a45cd70299', 'bece22ee-596a-43a0-8896-1854e8286743'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:12 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-48020604-e29b-4b5a-b1d6-9ea842253353 tempest-GroupSnapshotsTest-1554300411 None] group_snapshot dec58bcc-80a6-4c65-8963-e4b14d67d7fc: deleted successfully
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-c3514cb5-7311-49ae-8d32-6f114e70ae8d-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:12 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c" returned: 0 in 0.804s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-c3514cb5-7311-49ae-8d32-6f114e70ae8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:12 devstack sudo[85446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c
Apr 10 10:34:12 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-quobyte-c3514cb5-7311-49ae-8d32-6f114e70ae8d" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-c3514cb5-7311-49ae-8d32-6f114e70ae8d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Deleting offline snapshot c3514cb5-7311-49ae-8d32-6f114e70ae8d of volume bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] snapshot_file for this snap is: volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9098359-4023-4b58-bde3-b3d710435fa0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:12 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d
Apr 10 10:34:12 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "cinder-quobyte-58199898-29dd-475d-a947-1a28dce821f7" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-58199898-29dd-475d-a947-1a28dce821f7" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:13 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87d1427d-86f8-4717-8fd7-dc007d3ed41c" returned: 0 in 0.535s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6784f0dc-5ecf-4ba4-bcdf-3ccadb508c5f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-quobyte-87d1427d-86f8-4717-8fd7-dc007d3ed41c" released by "delete_volume" :: held 1.378s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG cinder.quota [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Created reservations ['9c398629-1f26-42f4-afb3-36e0090eda15', '55eb3ff8-5b25-4f33-869f-9f92f4eee91a', '7700528c-4b9a-4f10-954b-33c8b4c12e0f', '2c33965a-ffc0-46fd-b4a5-d867b7e66dce'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:13 devstack sudo[85451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7
Apr 10 10:34:13 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:13 devstack sudo[85453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:34:13 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:13 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d" returned: 0 in 0.786s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf606ff1-ef87-4887-b920-d51d67be0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[991787ca-0354-41ac-b5fa-c068930e2fdd]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:13 devstack sudo[85458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d
Apr 10 10:34:13 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:14 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7" returned: 0 in 0.641s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:14 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.manager [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:34:14 devstack cinder-volume[81969]: INFO cinder.volume.manager [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Deleted volume successfully.
Apr 10 10:34:14 devstack sudo[85464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7
Apr 10 10:34:14 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [req-62070ed7-e4d2-4386-a7ff-f4d7c22bf405 req-d766a9a3-cc01-45f2-babb-01f942987e3d tempest-ServerBootFromVolumeStableRescueTest-147161644 None] Lock "cinder-87d1427d-86f8-4717-8fd7-dc007d3ed41c-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:14 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d" returned: 0 in 0.568s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf606ff1-ef87-4887-b920-d51d67be0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:14 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d
Apr 10 10:34:14 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:14 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-58199898-29dd-475d-a947-1a28dce821f7" returned: 0 in 0.503s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Lock "cinder-quobyte-58199898-29dd-475d-a947-1a28dce821f7" released by "delete_volume" :: held 1.206s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['9ee6edd4-2158-4387-90ea-ae364916fa61'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:14 devstack cinder-volume[81969]: WARNING cinder.quota [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-323647211 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-323647211, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Created reservations ['d84713c2-12a1-4bf7-bdad-2ed6fef261ad', '4946a469-acd9-414a-b1bf-53f14861c25e', '89932ad2-853d-45e1-a837-15e40cbae6b7', 'd7fc52c0-48ca-487c-8b59-e62671a99756'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:14 devstack sudo[85472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:34:14 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:14 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d" returned: 0 in 0.701s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:15 devstack sudo[85477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d
Apr 10 10:34:15 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:15 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.560s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:34:15 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3782aba5-dbdd-4f16-9f56-ad9e20e80955 tempest-GroupSnapshotsTest-1554300411 None] Delete group completed successfully.
Apr 10 10:34:15 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.c3514cb5-7311-49ae-8d32-6f114e70ae8d" returned: 0 in 0.563s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-c3514cb5-7311-49ae-8d32-6f114e70ae8d" released by "_delete_snapshot" :: held 2.702s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" released by "delete_snapshot" :: held 2.719s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Created reservations ['22e2cc07-84b7-4b5a-abbd-616c902e75a8', '617d63ad-790f-413a-b936-d7d36af1fd13', 'c14effa8-f3a3-484b-b795-882593a8678f', '8fc4c158-1657-4272-9ffb-f6e44005ba5f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:15 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Delete snapshot completed successfully.
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab60f93b-6618-4ee4-aa33-b465a94ae301 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-c3514cb5-7311-49ae-8d32-6f114e70ae8d-delete_snapshot" released by "delete_snapshot" :: held 2.852s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-2399cdac-8f57-49cf-9201-9279f9741e5d-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-2399cdac-8f57-49cf-9201-9279f9741e5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-quobyte-2399cdac-8f57-49cf-9201-9279f9741e5d" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-2399cdac-8f57-49cf-9201-9279f9741e5d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Deleting offline snapshot 2399cdac-8f57-49cf-9201-9279f9741e5d of volume bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] snapshot_file for this snap is: volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6337c9b-17e2-4475-af04-08c1040f3015]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:16 devstack sudo[85481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d
Apr 10 10:34:16 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:16 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d" returned: 0 in 0.754s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf606ff1-ef87-4887-b920-d51d67be0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b717a1d-17ce-4646-9018-3bbfa2e1b8c6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:17 devstack sudo[85512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a
Apr 10 10:34:17 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:17 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" returned: 0 in 0.706s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf606ff1-ef87-4887-b920-d51d67be0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:17 devstack sudo[85518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d
Apr 10 10:34:17 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:18 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d" returned: 0 in 0.785s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:18 devstack sudo[85523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d
Apr 10 10:34:18 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:19 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.2399cdac-8f57-49cf-9201-9279f9741e5d" returned: 0 in 0.837s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-2399cdac-8f57-49cf-9201-9279f9741e5d" released by "_delete_snapshot" :: held 3.199s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" released by "delete_snapshot" :: held 3.214s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:19 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=179,cinder:UPDATE=168,cinder:INSERT=57,cinder:DELETE=5 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:34:19 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Created reservations ['5f1aa079-23cd-4efa-af0a-9b0914295ec1', 'a64e62aa-dd82-4415-a748-e496fe1db60b', 'bf581073-9c13-4c11-a513-0506a2c9d281', '30a60d23-2661-4a8a-8a34-5d9a546ea34e'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Delete snapshot completed successfully.
Apr 10 10:34:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c67814dd-9c69-4764-8c4a-f2395b512860 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-2399cdac-8f57-49cf-9201-9279f9741e5d-delete_snapshot" released by "delete_snapshot" :: held 3.351s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-quobyte-7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Deleting offline snapshot 7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a of volume bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] snapshot_file for this snap is: volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2c311e-9ef2-4304-8b7b-1b962a2f2f57]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:20 devstack sudo[85544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a
Apr 10 10:34:20 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:20 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" returned: 0 in 0.554s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf606ff1-ef87-4887-b920-d51d67be0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd0d33-83c1-4912-8a22-53019cb0d35c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:20 devstack sudo[85549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9
Apr 10 10:34:20 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:21 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9" returned: 0 in 0.791s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:21 devstack sudo[85554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a
Apr 10 10:34:21 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:22 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" returned: 0 in 0.752s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:22 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a
Apr 10 10:34:22 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:23 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9.7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" returned: 0 in 0.718s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a" released by "_delete_snapshot" :: held 2.917s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" released by "delete_snapshot" :: held 2.932s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Created reservations ['da2ba863-934e-41f1-bc42-cccc6a45cc70', 'e4a625f9-cfea-4ba7-8930-2efa90fde2a4', '4b0c5a4c-360c-48f5-9f8d-f04e846eed7f', 'cd79c9b5-33c5-4104-a729-c44ad44803d4'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:23 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Delete snapshot completed successfully.
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a880ede8-6e29-4b8b-ad11-892592aee796 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-7c1fb2f3-ffd2-4c5f-89b0-0a9d5593313a-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-bf606ff1-ef87-4887-b920-d51d67be0ae9-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-bf606ff1-ef87-4887-b920-d51d67be0ae9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[0041084c-fdee-4c7d-9116-71bbc67f93f3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:23 devstack sudo[85565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9
Apr 10 10:34:23 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:24 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9" returned: 0 in 0.654s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:24 devstack sudo[85571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9
Apr 10 10:34:24 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:24 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf606ff1-ef87-4887-b920-d51d67be0ae9" returned: 0 in 0.573s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-quobyte-bf606ff1-ef87-4887-b920-d51d67be0ae9" released by "delete_volume" :: held 1.291s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:24 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Created reservations ['5f732cc1-6f2a-405a-b888-27ec0466dc9c', '28757a99-4c2d-4139-85be-2a617c994abb', 'b4e23af1-02b9-40c7-a0ac-ccaba23f741a', '7ba63981-4410-4798-b6e3-c6c0b0b45599'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:25 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:34:25 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:26 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 1.331s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:26 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:34:26 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Deleted volume successfully.
Apr 10 10:34:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-05185f7f-dbc9-47ca-b449-a50dabac0fe6 tempest-VolumesSnapshotListTestJSON-1256935369 None] Lock "cinder-bf606ff1-ef87-4887-b920-d51d67be0ae9-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Flow 'volume_create_manager' (d7a2eb9a-a819-4792-baac-5e50bdceb724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edd7126-f724-4218-8f28-8b4fc409dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edd7126-f724-4218-8f28-8b4fc409dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-246104273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ac041e-161f-470c-abbb-1270ccd0bc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c31d81add6f4979b6e5784d7300cff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:28Z,use_quota=True,user_id='9d8e08e8c59f413884e8e78ef4cd0146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfc0e21-dfe8-428c-a733-2f612827f715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfc0e21-dfe8-428c-a733-2f612827f715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c29332e-e44a-451a-b264-6c66a7ffe279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c29332e-e44a-451a-b264-6c66a7ffe279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ac041e-161f-470c-abbb-1270ccd0bc2c', 'volume_name': 'volume-25ac041e-161f-470c-abbb-1270ccd0bc2c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b64505-7c3b-4790-9f16-53d7f2d3d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b64505-7c3b-4790-9f16-53d7f2d3d976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7666c7d-cf49-4157-a334-d60991e989bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:27 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Volume 25ac041e-161f-470c-abbb-1270ccd0bc2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ac041e-161f-470c-abbb-1270ccd0bc2c', 'volume_size': 1}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-246104273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ac041e-161f-470c-abbb-1270ccd0bc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c31d81add6f4979b6e5784d7300cff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:28Z,use_quota=True,user_id='9d8e08e8c59f413884e8e78ef4cd0146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Creating volume 25ac041e-161f-470c-abbb-1270ccd0bc2c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:34:27 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b35cce6-1b37-4dd9-bd20-aa6ee91dbf35 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" by "attach_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b35cce6-1b37-4dd9-bd20-aa6ee91dbf35 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" acquired by "attach_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:27 devstack sudo[85608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c 1073741824
Apr 10 10:34:27 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:27 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5b35cce6-1b37-4dd9-bd20-aa6ee91dbf35 tempest-VolumesActionsTest-1554026035 None] Attaching volume b33c7859-abe5-4ee5-884a-c0b4b38f5a6e to instance 1c193e57-52a8-431e-8f27-2a21f3a2090c at mountpoint /dev/vdb on host None.
Apr 10 10:34:27 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5b35cce6-1b37-4dd9-bd20-aa6ee91dbf35 tempest-VolumesActionsTest-1554026035 None] Attach volume completed successfully.
Apr 10 10:34:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b35cce6-1b37-4dd9-bd20-aa6ee91dbf35 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" released by "attach_volume" :: held 0.079s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-08d76707-6213-4b11-b190-3411643b9624 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-detach_volume" by "detach_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-08d76707-6213-4b11-b190-3411643b9624 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-08d76707-6213-4b11-b190-3411643b9624 tempest-VolumesActionsTest-1554026035 None] Detaching volume b33c7859-abe5-4ee5-884a-c0b4b38f5a6e from instance 1c193e57-52a8-431e-8f27-2a21f3a2090c.
Apr 10 10:34:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-08d76707-6213-4b11-b190-3411643b9624 tempest-VolumesActionsTest-1554026035 None] Detach volume completed successfully.
Apr 10 10:34:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-08d76707-6213-4b11-b190-3411643b9624 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:28 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c 1073741824" returned: 0 in 0.822s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:28 devstack sudo[85613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c
Apr 10 10:34:28 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:29 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7666c7d-cf49-4157-a334-d60991e989bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ac041e-161f-470c-abbb-1270ccd0bc2c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7e8b3a-3231-470a-8178-edf5ca686d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:29 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Volume volume-25ac041e-161f-470c-abbb-1270ccd0bc2c (25ac041e-161f-470c-abbb-1270ccd0bc2c): created successfully
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7e8b3a-3231-470a-8178-edf5ca686d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Flow 'volume_create_manager' (d7a2eb9a-a819-4792-baac-5e50bdceb724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f110864f-5029-4918-97b5-e1f0369d03a3 tempest-VolumeQuotasAdminTestJSON-1692452132 None] Created volume successfully.
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Flow 'volume_create_manager' (ef5c06f9-07d0-4db1-bd7d-f120965f609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24303667-9b5c-4c42-92d2-e43e3056e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24303667-9b5c-4c42-92d2-e43e3056e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1204386780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a45e773-7983-4641-beef-8a8958114a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a90d96ed8df4a06819975ead5c198e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:30Z,use_quota=True,user_id='f571746838f446a0b28bcef5e38df605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea91c408-5908-48b9-b231-28321ab6a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea91c408-5908-48b9-b231-28321ab6a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f860cc89-1145-4173-9018-7401feb2001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f860cc89-1145-4173-9018-7401feb2001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a45e773-7983-4641-beef-8a8958114a3a', 'volume_name': 'volume-3a45e773-7983-4641-beef-8a8958114a3a', 'volume_size': 2}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed57a5d3-5dba-418e-8bec-9b3e45e55995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed57a5d3-5dba-418e-8bec-9b3e45e55995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4483b55-8483-4ff2-ab07-2b5610ceb963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:29 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Volume 3a45e773-7983-4641-beef-8a8958114a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a45e773-7983-4641-beef-8a8958114a3a', 'volume_size': 2}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1204386780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a45e773-7983-4641-beef-8a8958114a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a90d96ed8df4a06819975ead5c198e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:30Z,use_quota=True,user_id='f571746838f446a0b28bcef5e38df605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Creating volume 3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:34:29 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a 2147483648 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:29 devstack sudo[85617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a 2147483648
Apr 10 10:34:29 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Acquiring lock "cinder-25ac041e-161f-470c-abbb-1270ccd0bc2c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "cinder-25ac041e-161f-470c-abbb-1270ccd0bc2c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Acquiring lock "cinder-quobyte-25ac041e-161f-470c-abbb-1270ccd0bc2c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "cinder-quobyte-25ac041e-161f-470c-abbb-1270ccd0bc2c" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c7d54-0fec-4021-ad26-44722de2113e]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:30 devstack sudo[85619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c
Apr 10 10:34:30 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:30 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a 2147483648" returned: 0 in 0.756s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:30 devstack sudo[85649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a
Apr 10 10:34:30 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:30 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c" returned: 0 in 0.760s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:30 devstack sudo[85653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c
Apr 10 10:34:30 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:31 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a" returned: 0 in 0.694s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4483b55-8483-4ff2-ab07-2b5610ceb963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a45e773-7983-4641-beef-8a8958114a3a', 'volume_size': 2}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4022ea00-e133-49cf-a396-ef59e3d9f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:31 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Volume volume-3a45e773-7983-4641-beef-8a8958114a3a (3a45e773-7983-4641-beef-8a8958114a3a): created successfully
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4022ea00-e133-49cf-a396-ef59e3d9f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Flow 'volume_create_manager' (ef5c06f9-07d0-4db1-bd7d-f120965f609e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1d448144-c411-4b8b-b6a6-5b62f7323c36 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Created volume successfully.
Apr 10 10:34:31 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-25ac041e-161f-470c-abbb-1270ccd0bc2c" returned: 0 in 0.673s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "cinder-quobyte-25ac041e-161f-470c-abbb-1270ccd0bc2c" released by "delete_volume" :: held 1.460s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Created reservations ['7e407d34-2716-4a25-81d8-9284b62b0cff', '03150ee1-c546-4294-8ad1-f0f0bc00619a', 'cc244815-0a64-4e3d-86a5-8f13beea8906', '9288bbfa-a9aa-4751-b21c-84f90c46540b'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:31 devstack sudo[85658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:34:31 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Creating offline snapshot 72b76fef-322b-413e-9d7c-5fa4657c27ad of volume 3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b696d3-f844-4093-91b5-41e46c0850c0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:32 devstack sudo[85660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a
Apr 10 10:34:32 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:32 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.767s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:34:32 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Deleted volume successfully.
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-918ca161-f2b6-4fb7-b4cf-da49ce55489d tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "cinder-25ac041e-161f-470c-abbb-1270ccd0bc2c-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Flow 'volume_create_manager' (5e6901ff-8a85-4c67-8877-1cdad5ebaf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82baad8-d2fd-4a52-ae91-e3dc61e32227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82baad8-d2fd-4a52-ae91-e3dc61e32227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-544201248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df47a088-5105-4c47-9491-8d180f818934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c31d81add6f4979b6e5784d7300cff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:33Z,use_quota=True,user_id='9d8e08e8c59f413884e8e78ef4cd0146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0fd30b-53bd-45f8-a4d9-d9e57e091733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0fd30b-53bd-45f8-a4d9-d9e57e091733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e9c380-f6c0-4e8a-9534-7bc4d7bf48ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e9c380-f6c0-4e8a-9534-7bc4d7bf48ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df47a088-5105-4c47-9491-8d180f818934', 'volume_name': 'volume-df47a088-5105-4c47-9491-8d180f818934', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c70214a-aad7-436a-bbe6-34a9d5affab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c70214a-aad7-436a-bbe6-34a9d5affab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1143eaca-54be-4405-b454-af1da9b74193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:32 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Volume df47a088-5105-4c47-9491-8d180f818934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df47a088-5105-4c47-9491-8d180f818934', 'volume_size': 1}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:32 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a" returned: 0 in 0.727s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad 2G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:32 devstack sudo[85667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad 2G
Apr 10 10:34:32 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:33 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad 2G" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a45e773-7983-4641-beef-8a8958114a3a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:33 devstack sudo[85672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a45e773-7983-4641-beef-8a8958114a3a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad
Apr 10 10:34:33 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:34 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a45e773-7983-4641-beef-8a8958114a3a -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad" returned: 0 in 0.709s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:34 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad is being set with open permissions: ugo+rw
Apr 10 10:34:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:34 devstack sudo[85677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad
Apr 10 10:34:34 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:34 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad" returned: 0 in 0.599s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:34 devstack sudo[85680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.info
Apr 10 10:34:34 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:35 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.info" returned: 0 in 0.476s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:35 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.info is being set with open permissions: ugo+rw
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:35 devstack sudo[85683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.info
Apr 10 10:34:35 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:35 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.info" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.677s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.079s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-544201248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df47a088-5105-4c47-9491-8d180f818934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c31d81add6f4979b6e5784d7300cff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:33Z,use_quota=True,user_id='9d8e08e8c59f413884e8e78ef4cd0146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Creating volume df47a088-5105-4c47-9491-8d180f818934 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:34:35 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:34:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:35 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-88067755-fad1-4379-8b64-6cf325aee3b8 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Create snapshot completed successfully
Apr 10 10:34:35 devstack sudo[85686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934 1073741824
Apr 10 10:34:35 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "cinder-72b76fef-322b-413e-9d7c-5fa4657c27ad-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-72b76fef-322b-413e-9d7c-5fa4657c27ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "cinder-quobyte-3a45e773-7983-4641-beef-8a8958114a3a" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-quobyte-3a45e773-7983-4641-beef-8a8958114a3a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "cinder-quobyte-72b76fef-322b-413e-9d7c-5fa4657c27ad" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-quobyte-72b76fef-322b-413e-9d7c-5fa4657c27ad" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Deleting offline snapshot 72b76fef-322b-413e-9d7c-5fa4657c27ad of volume 3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] snapshot_file for this snap is: volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23caa66-4481-401e-897c-2b3a8d41ed3c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:36 devstack sudo[85691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad
Apr 10 10:34:36 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:36 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934 1073741824" returned: 0 in 0.846s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:36 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934
Apr 10 10:34:36 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:37 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad" returned: 0 in 0.761s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a45e773-7983-4641-beef-8a8958114a3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[596816df-7a28-4693-9719-c79552fc8d84]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:37 devstack sudo[85698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a
Apr 10 10:34:37 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:37 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934" returned: 0 in 0.753s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1143eaca-54be-4405-b454-af1da9b74193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df47a088-5105-4c47-9491-8d180f818934', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ab16e5-435f-4ed4-b7f2-f45f5a8e434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:37 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Volume volume-df47a088-5105-4c47-9491-8d180f818934 (df47a088-5105-4c47-9491-8d180f818934): created successfully
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ab16e5-435f-4ed4-b7f2-f45f5a8e434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Flow 'volume_create_manager' (5e6901ff-8a85-4c67-8877-1cdad5ebaf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:37 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1644c4f1-4c50-4179-8a1c-f6575b094b8b tempest-VolumeQuotasAdminTestJSON-1692452132 None] Created volume successfully.
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:37 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:34:37 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8607bcef-2e9f-4770-8e89-09f663b371bf]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:37 devstack sudo[85703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:34:37 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:37 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a" returned: 0 in 0.614s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:37 devstack sudo[85708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad
Apr 10 10:34:37 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:38 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.621s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:34:38 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad" returned: 0 in 0.580s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:38 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.887s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a171441-8f39-4328-8aab-66e82b645dde]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:38 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad
Apr 10 10:34:38 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:38 devstack sudo[85718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:34:38 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:38 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=141,cinder:UPDATE=150,cinder:INSERT=44,cinder:DELETE=8 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:34:38 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-597d0626-566c-4842-81d1-868778523818 tempest-VolumeQuotasAdminTestJSON-1535534738 None] Transfer volume completed successfully.
Apr 10 10:34:39 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a.72b76fef-322b-413e-9d7c-5fa4657c27ad" returned: 0 in 0.708s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-quobyte-72b76fef-322b-413e-9d7c-5fa4657c27ad" released by "_delete_snapshot" :: held 2.765s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-quobyte-3a45e773-7983-4641-beef-8a8958114a3a" released by "delete_snapshot" :: held 2.781s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Created reservations ['2750a411-c46e-4826-b956-2f21216d5dec', '33195763-f002-4948-a0d0-d4c9e4715bfc', 'af63376d-4ff7-411c-9580-f0657a86e4aa', '5920b249-5629-4c41-86bf-6dd9d768db1d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:39 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.764s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.5a0d4c11-95a3-4932-8ee8-821a3bc75113ykujeaz5.img {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:39 devstack sudo[85725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.5a0d4c11-95a3-4932-8ee8-821a3bc75113ykujeaz5.img
Apr 10 10:34:39 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:39 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Delete snapshot completed successfully.
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-34dfde3f-ccb1-47d1-8031-d7537b88bd72 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-72b76fef-322b-413e-9d7c-5fa4657c27ad-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "cinder-3a45e773-7983-4641-beef-8a8958114a3a-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-3a45e773-7983-4641-beef-8a8958114a3a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "cinder-quobyte-3a45e773-7983-4641-beef-8a8958114a3a" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-quobyte-3a45e773-7983-4641-beef-8a8958114a3a" acquired by "delete_volume" :: waited 0.033s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[43718efc-8a07-469f-bd16-9663e261c288]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Acquiring lock "cinder-df47a088-5105-4c47-9491-8d180f818934-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Lock "cinder-df47a088-5105-4c47-9491-8d180f818934-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:39 devstack sudo[85728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a
Apr 10 10:34:39 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Acquiring lock "cinder-quobyte-df47a088-5105-4c47-9491-8d180f818934" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Lock "cinder-quobyte-df47a088-5105-4c47-9491-8d180f818934" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93dae11-b5f1-4e78-8dbe-83770e48b237]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:39 devstack sudo[85731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934
Apr 10 10:34:39 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:41 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a" returned: 0 in 1.755s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:41 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a
Apr 10 10:34:41 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:41 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934" returned: 0 in 1.733s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:41 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934
Apr 10 10:34:41 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:41 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.5a0d4c11-95a3-4932-8ee8-821a3bc75113ykujeaz5.img" returned: 0 in 2.801s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:41 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db04d6-848b-440d-83bf-0dfd404ffe57]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:42 devstack sudo[85756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:34:42 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:42 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-df47a088-5105-4c47-9491-8d180f818934" returned: 0 in 0.815s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Lock "cinder-quobyte-df47a088-5105-4c47-9491-8d180f818934" released by "delete_volume" :: held 2.576s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:42 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3a45e773-7983-4641-beef-8a8958114a3a" returned: 0 in 1.032s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-quobyte-3a45e773-7983-4641-beef-8a8958114a3a" released by "delete_volume" :: held 2.823s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Created reservations ['c0fd14d9-d4d5-40f2-b1bf-a62a3f950147', '06c17cf2-1f54-4339-90fa-d7174699d8ce', '4b73a078-247a-4a5f-8c6f-a72faec6b65c', 'e12a36da-64fa-4b96-a82b-d98b4560934d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:42 devstack sudo[85762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:34:42 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Created reservations ['13a022dc-b34e-48ca-9753-f1bfdd947844', '5c3b134a-01d5-4c9b-ab66-48798b593a42', '77db857f-dd76-4e70-b225-dda9407836b2', '3860e707-1511-472e-9347-1c4ecf1d7a7e'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:42 devstack sudo[85764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:34:42 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:42 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.899s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e, size 1024.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.5a0d4c11-95a3-4932-8ee8-821a3bc75113ykujeaz5.img {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:34:42 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Converted 1024.00 MB image at 365.40 MB/s
Apr 10 10:34:42 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] 5a0d4c11-95a3-4932-8ee8-821a3bc75113 was raw, no need to convert to raw {{(pid=81969) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 10 10:34:43 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.891s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:43 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:34:43 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Deleted volume successfully.
Apr 10 10:34:43 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.850s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:43 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:34:43 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Deleted volume successfully.
Apr 10 10:34:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c97d5667-88fe-4747-84fc-f90bf413e7f3 tempest-VolumeQuotasAdminTestJSON-2042576399 None] Lock "cinder-df47a088-5105-4c47-9491-8d180f818934-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4374beef-9b6c-4d09-83ec-a4f722a93442 tempest-VolumesSnapshotNegativeTestJSON-1147512410 None] Lock "cinder-3a45e773-7983-4641-beef-8a8958114a3a-delete_volume" released by "delete_volume" :: held 3.981s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:34:53 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:UPDATE=55,cinder:SELECT=58,cinder:INSERT=13,cinder:DELETE=5 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:34:53 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Flow 'volume_create_manager' (66987b53-cb1f-4971-bd8e-8c0e5b3ec4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e121d945-5be4-4fe6-a6a2-fdd2b781973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e121d945-5be4-4fe6-a6a2-fdd2b781973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1796263789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589550f7-8375-47b7-94be-1299484b2b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9a5276eeab4c3aa6e8fa7e9cceb7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:54Z,use_quota=True,user_id='3f48782bb88b4303b4c993fe6fa1431f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c733ee4-d72a-438b-9ab6-c64f7c934a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c733ee4-d72a-438b-9ab6-c64f7c934a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edad5ce7-ea91-428f-9631-4bb89af10d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edad5ce7-ea91-428f-9631-4bb89af10d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589550f7-8375-47b7-94be-1299484b2b90', 'volume_name': 'volume-589550f7-8375-47b7-94be-1299484b2b90', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefec044-d681-4367-98ee-a35dcf3e2230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefec044-d681-4367-98ee-a35dcf3e2230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f61b796-3b41-43a3-9c17-3e019d30f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:55 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Volume 589550f7-8375-47b7-94be-1299484b2b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589550f7-8375-47b7-94be-1299484b2b90', 'volume_size': 1}
Apr 10 10:34:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.103s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Uploaded volume to glance image-id: 5a0d4c11-95a3-4932-8ee8-821a3bc75113. {{(pid=81969) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1796263789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589550f7-8375-47b7-94be-1299484b2b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9a5276eeab4c3aa6e8fa7e9cceb7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:54Z,use_quota=True,user_id='3f48782bb88b4303b4c993fe6fa1431f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Creating volume 589550f7-8375-47b7-94be-1299484b2b90 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:34:57 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:34:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:57 devstack sudo[85913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90 1073741824
Apr 10 10:34:57 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1756dd50-0165-4c80-a836-bd4cbc67a5ee tempest-VolumesActionsTest-1554026035 None] Copy volume to image completed successfully.
Apr 10 10:34:58 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90 1073741824" returned: 0 in 0.612s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:58 devstack sudo[85918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90
Apr 10 10:34:58 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:58 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90" returned: 0 in 0.634s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f61b796-3b41-43a3-9c17-3e019d30f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589550f7-8375-47b7-94be-1299484b2b90', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee207c5-130f-4fd2-a9f5-4e126c88248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:34:58 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Volume volume-589550f7-8375-47b7-94be-1299484b2b90 (589550f7-8375-47b7-94be-1299484b2b90): created successfully
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee207c5-130f-4fd2-a9f5-4e126c88248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:34:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Flow 'volume_create_manager' (66987b53-cb1f-4971-bd8e-8c0e5b3ec4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:34:58 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a6de42df-a512-449a-8a87-bcbeb727d498 tempest-VolumesListAdminTestJSON-308634114 None] Created volume successfully.
Apr 10 10:34:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:34:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:34:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d80e11-e438-43f2-b422-7b3f8280dbc1]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:59 devstack sudo[85921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:34:59 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:34:59 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root
Apr 10 10:34:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.548s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:34:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9ea08-4e58-47fb-b19b-2d5ecba2c393]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:34:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:34:59 devstack sudo[85927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:34:59 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Flow 'volume_create_manager' (786ea0c8-eb7d-4649-9e1d-8b74afc3acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d796b8c9-0485-4872-8270-d87848cb025a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:00 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d796b8c9-0485-4872-8270-d87848cb025a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-867092753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3573828f-1f8d-48eb-b15e-91b101ae686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9a5276eeab4c3aa6e8fa7e9cceb7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:00Z,use_quota=True,user_id='3f48782bb88b4303b4c993fe6fa1431f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e755772-f248-468b-9901-82845f1f3589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e755772-f248-468b-9901-82845f1f3589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7860705c-6109-425e-b4ca-352b9da76faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7860705c-6109-425e-b4ca-352b9da76faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3573828f-1f8d-48eb-b15e-91b101ae686e', 'volume_name': 'volume-3573828f-1f8d-48eb-b15e-91b101ae686e', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd73b9bb-b1e0-4ca7-a6c6-8e5ba1962f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd73b9bb-b1e0-4ca7-a6c6-8e5ba1962f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000aba2b-443c-4c98-90da-ef9cc79d15f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:00 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Volume 3573828f-1f8d-48eb-b15e-91b101ae686e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3573828f-1f8d-48eb-b15e-91b101ae686e', 'volume_size': 1}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.821s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:00 devstack sudo[85932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img
Apr 10 10:35:00 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:04 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img" returned: 0 in 3.834s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:04 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c341c54-dbd6-4d01-957d-d46dc9520afc]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:04 devstack sudo[85944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:35:04 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:05 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.912s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:05 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:35:05 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Converted 1024.00 MB image at 266.95 MB/s
Apr 10 10:35:05 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] 6ef5a7d4-b291-4113-bef0-70b1329c1a95 was raw, converting to qcow2 {{(pid=81969) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 10 10:35:05 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14fbc0-6de6-4642-9a8f-e18f37b16954]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:05 devstack sudo[85975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img
Apr 10 10:35:05 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:05 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img" returned: 0 in 0.509s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:05 devstack sudo[85979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img
Apr 10 10:35:05 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:06 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img" returned: 1 in 0.521s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:35:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img /opt/stack/data/cinder/conversion/vol_upload_2k1q5d39 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:06 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img /opt/stack/data/cinder/conversion/vol_upload_2k1q5d39
Apr 10 10:35:06 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:06 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img /opt/stack/data/cinder/conversion/vol_upload_2k1q5d39" returned: 0 in 0.467s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:06 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Image conversion details: src /opt/stack/data/cinder/conversion/b33c7859-abe5-4ee5-884a-c0b4b38f5a6e.temp_image.6ef5a7d4-b291-4113-bef0-70b1329c1a95bc0v22ns.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2k1q5d39 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:35:06 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 10 10:35:06 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb89241-c221-4ab7-8dab-92526cdaedc5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2k1q5d39 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:06 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2k1q5d39
Apr 10 10:35:06 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:07 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2k1q5d39" returned: 0 in 0.562s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.307s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Uploaded volume to glance image-id: 6ef5a7d4-b291-4113-bef0-70b1329c1a95. {{(pid=81969) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.904s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-867092753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3573828f-1f8d-48eb-b15e-91b101ae686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9a5276eeab4c3aa6e8fa7e9cceb7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:00Z,use_quota=True,user_id='3f48782bb88b4303b4c993fe6fa1431f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Creating volume 3573828f-1f8d-48eb-b15e-91b101ae686e {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:08 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:08 devstack sudo[86001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e 1073741824
Apr 10 10:35:08 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:08 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9640f548-430b-4012-8ae3-4d50a0987a78 tempest-VolumesActionsTest-1554026035 None] Copy volume to image completed successfully.
Apr 10 10:35:08 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e 1073741824" returned: 0 in 0.613s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:09 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e
Apr 10 10:35:09 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "cinder-quobyte-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-quobyte-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b59c3d-d6bb-4767-8605-c7ef44184221]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:09 devstack sudo[86034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:35:09 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:09 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e" returned: 0 in 0.852s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000aba2b-443c-4c98-90da-ef9cc79d15f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3573828f-1f8d-48eb-b15e-91b101ae686e', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de8b191-c4fa-437e-909d-8ee0e28a3cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:09 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Volume volume-3573828f-1f8d-48eb-b15e-91b101ae686e (3573828f-1f8d-48eb-b15e-91b101ae686e): created successfully
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de8b191-c4fa-437e-909d-8ee0e28a3cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Flow 'volume_create_manager' (786ea0c8-eb7d-4649-9e1d-8b74afc3acd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:09 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b4a95592-c939-4e3e-a8a1-6df47297ce42 tempest-VolumesListAdminTestJSON-308634114 None] Created volume successfully.
Apr 10 10:35:10 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 1.165s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:10 devstack sudo[86043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e
Apr 10 10:35:10 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Flow 'volume_create_manager' (224c0b7a-d06b-4d4a-a084-09133af3f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab728a88-d8a1-4397-9781-c1c3483511fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab728a88-d8a1-4397-9781-c1c3483511fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1992568177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eee0501-6eee-487a-899f-fe4c77e969c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9a5276eeab4c3aa6e8fa7e9cceb7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:11Z,use_quota=True,user_id='3f48782bb88b4303b4c993fe6fa1431f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75626dd7-eed3-48de-ab7f-f6ba9f3a01a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75626dd7-eed3-48de-ab7f-f6ba9f3a01a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c65e7d-e774-4df9-94a8-bb216f5406c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c65e7d-e774-4df9-94a8-bb216f5406c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eee0501-6eee-487a-899f-fe4c77e969c8', 'volume_name': 'volume-1eee0501-6eee-487a-899f-fe4c77e969c8', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bbbe6-b275-4f78-b203-5b9803a3529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bbbe6-b275-4f78-b203-5b9803a3529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9663e2e-22bc-413b-bc94-8ebc507c7f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:10 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Volume 1eee0501-6eee-487a-899f-fe4c77e969c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eee0501-6eee-487a-899f-fe4c77e969c8', 'volume_size': 1}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1992568177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eee0501-6eee-487a-899f-fe4c77e969c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9a5276eeab4c3aa6e8fa7e9cceb7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:11Z,use_quota=True,user_id='3f48782bb88b4303b4c993fe6fa1431f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Creating volume 1eee0501-6eee-487a-899f-fe4c77e969c8 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:10 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:10 devstack sudo[86045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8 1073741824
Apr 10 10:35:10 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:10 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" returned: 0 in 0.538s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-quobyte-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e" released by "delete_volume" :: held 1.775s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Created reservations ['cd825398-db20-4e0f-ac14-b6fd18174428', 'd0f4530a-e260-4558-a2ec-d83b0add5070', '6c92395d-bd75-40bd-896e-1b408bf4a233', 'a287c240-0853-4075-a9b5-4deec331e2fb'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:11 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:11 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:11 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8 1073741824" returned: 0 in 0.693s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:11 devstack sudo[86053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8
Apr 10 10:35:11 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:11 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.809s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:11 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Deleted volume successfully.
Apr 10 10:35:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-471c74d7-71ce-4473-9188-679e76226419 tempest-VolumesActionsTest-1554026035 None] Lock "cinder-b33c7859-abe5-4ee5-884a-c0b4b38f5a6e-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:12 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8" returned: 0 in 1.137s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9663e2e-22bc-413b-bc94-8ebc507c7f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eee0501-6eee-487a-899f-fe4c77e969c8', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e56fd5-d5e5-460f-a52b-47b09a4f08c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:12 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Volume volume-1eee0501-6eee-487a-899f-fe4c77e969c8 (1eee0501-6eee-487a-899f-fe4c77e969c8): created successfully
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e56fd5-d5e5-460f-a52b-47b09a4f08c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Flow 'volume_create_manager' (224c0b7a-d06b-4d4a-a084-09133af3f988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:12 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9798869a-1ef5-4493-9691-381f12aa27d0 tempest-VolumesListAdminTestJSON-308634114 None] Created volume successfully.
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Flow 'volume_create_manager' (11fd900b-c2a4-4a01-a50c-897cceaf36f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcede5aa-84f2-47fa-a241-6b16000c511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcede5aa-84f2-47fa-a241-6b16000c511f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-868811414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70540430-0757-4712-9d32-f4e97da1afee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a102e7b10eb402b93486f4bada8dd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:13Z,use_quota=True,user_id='6ce1ede3e09a4b56b32af402a34368d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead16cb2-2562-4593-895d-f800cfa23d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead16cb2-2562-4593-895d-f800cfa23d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ab13c1-7bae-4d8d-a592-bfd7e7a46cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ab13c1-7bae-4d8d-a592-bfd7e7a46cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70540430-0757-4712-9d32-f4e97da1afee', 'volume_name': 'volume-70540430-0757-4712-9d32-f4e97da1afee', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d9c7b0-a0bd-469d-9f0e-45d397830b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d9c7b0-a0bd-469d-9f0e-45d397830b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd2330f-9a44-4f92-9cf7-34e2c076bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:12 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Volume 70540430-0757-4712-9d32-f4e97da1afee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70540430-0757-4712-9d32-f4e97da1afee', 'volume_size': 1}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-868811414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70540430-0757-4712-9d32-f4e97da1afee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a102e7b10eb402b93486f4bada8dd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:13Z,use_quota=True,user_id='6ce1ede3e09a4b56b32af402a34368d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Creating volume 70540430-0757-4712-9d32-f4e97da1afee {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:12 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:12 devstack sudo[86057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee 1073741824
Apr 10 10:35:12 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Flow 'volume_create_manager' (0dd81e86-28a7-4866-87e6-145630d4cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651702f4-ea32-4f46-be33-fdaa9b2e644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651702f4-ea32-4f46-be33-fdaa9b2e644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef25f9c-30eb-49f1-ae80-52eb95e2a64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91bb506bdec4436a41921583933e02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:14Z,use_quota=True,user_id='cc767ebdbd384a62b500d6878323eadb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfbe20-7a47-4f9c-97bf-b598862336db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfbe20-7a47-4f9c-97bf-b598862336db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856d2126-c73e-44b4-8729-e493de761618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856d2126-c73e-44b4-8729-e493de761618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef25f9c-30eb-49f1-ae80-52eb95e2a64d', 'volume_name': 'volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6afa98b7-3e58-4303-88d0-de5a81e88c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6afa98b7-3e58-4303-88d0-de5a81e88c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca5bbb5-01cd-4aef-b4ed-e10c99d34770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:13 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Volume 7ef25f9c-30eb-49f1-ae80-52eb95e2a64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d', 'volume_size': 1}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:13 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee 1073741824" returned: 0 in 0.890s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:13 devstack sudo[86063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee
Apr 10 10:35:13 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:14 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee" returned: 0 in 0.525s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef25f9c-30eb-49f1-ae80-52eb95e2a64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91bb506bdec4436a41921583933e02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:14Z,use_quota=True,user_id='cc767ebdbd384a62b500d6878323eadb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Creating volume 7ef25f9c-30eb-49f1-ae80-52eb95e2a64d {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:14 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd2330f-9a44-4f92-9cf7-34e2c076bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70540430-0757-4712-9d32-f4e97da1afee', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0050a71f-a2d5-477b-86bb-143d7d9b20ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:14 devstack sudo[86066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d 1073741824
Apr 10 10:35:14 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:14 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Volume volume-70540430-0757-4712-9d32-f4e97da1afee (70540430-0757-4712-9d32-f4e97da1afee): created successfully
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0050a71f-a2d5-477b-86bb-143d7d9b20ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Flow 'volume_create_manager' (11fd900b-c2a4-4a01-a50c-897cceaf36f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:14 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e86aaeb6-e100-4d2a-99e0-66b7d6fa1543 tempest-ServerRescueNegativeTestJSON-1271329099 None] Created volume successfully.
Apr 10 10:35:15 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d 1073741824" returned: 0 in 0.921s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:15 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d
Apr 10 10:35:15 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:15 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d" returned: 0 in 0.680s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca5bbb5-01cd-4aef-b4ed-e10c99d34770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a4d955-00cb-4768-86ab-dd1d757c4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:16 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Volume volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d (7ef25f9c-30eb-49f1-ae80-52eb95e2a64d): created successfully
Apr 10 10:35:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a4d955-00cb-4768-86ab-dd1d757c4150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Flow 'volume_create_manager' (0dd81e86-28a7-4866-87e6-145630d4cf13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:16 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-41a4b5cd-1327-4fef-b02b-9a5ded0f5072 tempest-VolumesListAdminTestJSON-559582573 None] Created volume successfully.
Apr 10 10:35:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Acquiring lock "cinder-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Lock "cinder-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "cinder-1eee0501-6eee-487a-899f-fe4c77e969c8-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Acquiring lock "cinder-quobyte-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-1eee0501-6eee-487a-899f-fe4c77e969c8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Lock "cinder-quobyte-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d" acquired by "delete_volume" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5267162-7ddc-47bc-a378-7b11e15400fa]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "cinder-quobyte-1eee0501-6eee-487a-899f-fe4c77e969c8" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-quobyte-1eee0501-6eee-487a-899f-fe4c77e969c8" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8766dfa2-d34f-4390-bdff-60cfd7217ff4]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:17 devstack sudo[86076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d
Apr 10 10:35:17 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:17 devstack sudo[86077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8
Apr 10 10:35:17 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (76b0722b-5dad-47d5-a696-c537b8c845e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9196ca-5a14-435b-98e9-cf5dca53ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9196ca-5a14-435b-98e9-cf5dca53ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1512661229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60280f82-4625-47a4-a874-6af9ac295da0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:18Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84477e9c-abbb-49ea-bb5c-943c17b877f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84477e9c-abbb-49ea-bb5c-943c17b877f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2610848-dbec-4416-8997-4e9ec95f306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2610848-dbec-4416-8997-4e9ec95f306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60280f82-4625-47a4-a874-6af9ac295da0', 'volume_name': 'volume-60280f82-4625-47a4-a874-6af9ac295da0', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24278d33-6a1b-44a9-82eb-40e6a3bba1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24278d33-6a1b-44a9-82eb-40e6a3bba1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1bed86-b149-42f2-986d-8c507a388610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:18 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:18 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Volume 60280f82-4625-47a4-a874-6af9ac295da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60280f82-4625-47a4-a874-6af9ac295da0', 'volume_size': 1}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:18 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1512661229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60280f82-4625-47a4-a874-6af9ac295da0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:18Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Creating volume 60280f82-4625-47a4-a874-6af9ac295da0 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:18 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d" returned: 0 in 1.132s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:18 devstack sudo[86086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0 1073741824
Apr 10 10:35:18 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8" returned: 0 in 1.061s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:18 devstack sudo[86089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8
Apr 10 10:35:18 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:18 devstack sudo[86087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d
Apr 10 10:35:18 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:18 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1eee0501-6eee-487a-899f-fe4c77e969c8" returned: 0 in 0.542s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-quobyte-1eee0501-6eee-487a-899f-fe4c77e969c8" released by "delete_volume" :: held 1.648s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Created reservations ['8162472d-af9b-45f6-9c7a-ee40d78bdb2c', '1021ccc2-6ec9-4e15-935b-2daaea2d4766', 'b97451e7-3e56-493e-b6fc-ebf1580f8cb6', 'd749f903-1307-443a-a6a8-380f4a770b2b'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:19 devstack sudo[86122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:19 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:19 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0 1073741824" returned: 0 in 0.878s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:19 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d" returned: 0 in 0.911s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:19 devstack sudo[86125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0
Apr 10 10:35:19 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Lock "cinder-quobyte-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d" released by "delete_volume" :: held 2.146s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Created reservations ['8100e6ff-93fc-4f31-bfe0-f4698535db2e', '87276636-d843-4b3c-ba25-a28c5a3a2917', '56749e8e-1347-4f41-a824-338864140fbb', 'eb92658d-4718-47f7-a84c-78f3a2b0ca1d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "cinder-3573828f-1f8d-48eb-b15e-91b101ae686e-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:19 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:19 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-3573828f-1f8d-48eb-b15e-91b101ae686e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "cinder-quobyte-3573828f-1f8d-48eb-b15e-91b101ae686e" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-quobyte-3573828f-1f8d-48eb-b15e-91b101ae686e" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c8c8c-c8ac-425a-a70c-d9490ce38c43]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:19 devstack sudo[86131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e
Apr 10 10:35:19 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:19 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.877s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Deleted volume successfully.
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f735b6e8-3dac-4978-89c8-e7104b3e63b8 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-1eee0501-6eee-487a-899f-fe4c77e969c8-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:19 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.573s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:19 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Deleted volume successfully.
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-31501cea-a5eb-405d-a10a-e356c7a75cd3 tempest-VolumesListAdminTestJSON-559582573 None] Lock "cinder-7ef25f9c-30eb-49f1-ae80-52eb95e2a64d-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:20 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0" returned: 0 in 1.012s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1bed86-b149-42f2-986d-8c507a388610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60280f82-4625-47a4-a874-6af9ac295da0', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21ae6b-bc97-47b0-8f97-aebb17a83511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:20 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Volume volume-60280f82-4625-47a4-a874-6af9ac295da0 (60280f82-4625-47a4-a874-6af9ac295da0): created successfully
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21ae6b-bc97-47b0-8f97-aebb17a83511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (76b0722b-5dad-47d5-a696-c537b8c845e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:20 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c9a8c237-9114-4e50-9610-416ae0327586 tempest-VolumesGetTest-476577892 None] Created volume successfully.
Apr 10 10:35:20 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e" returned: 0 in 0.716s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:20 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e
Apr 10 10:35:20 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:20 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3573828f-1f8d-48eb-b15e-91b101ae686e" returned: 0 in 0.535s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-quobyte-3573828f-1f8d-48eb-b15e-91b101ae686e" released by "delete_volume" :: held 1.283s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Created reservations ['e724cadc-4c08-4d5a-8d22-5bcb6de6beb4', '73b808a2-1a18-469a-9e76-232f0578638d', '59667d33-6124-406c-8be2-abac568a4ba7', '0ad490a5-1724-464c-8ac3-15037734b9fd'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:20 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:20 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:21 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.525s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Deleted volume successfully.
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d8d113fb-dcdd-4197-a99f-de3791f755fd tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-3573828f-1f8d-48eb-b15e-91b101ae686e-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (f17ace8d-efe8-46d7-a370-96a162d8be28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e306a37-b263-46e6-9721-db53aca66910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e306a37-b263-46e6-9721-db53aca66910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1352078317',display_name='tempest-VolumesGetTest-Volume-1225888969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a82b601-adde-4285-95fc-949191f9d18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:22Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d1390a-1f28-41d4-91df-2e141359b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d1390a-1f28-41d4-91df-2e141359b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092fa8fb-4a2a-4cec-b834-07587b832c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092fa8fb-4a2a-4cec-b834-07587b832c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a82b601-adde-4285-95fc-949191f9d18c', 'volume_name': 'volume-6a82b601-adde-4285-95fc-949191f9d18c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5319ea8-424e-4ab5-b75c-cad69e232a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5319ea8-424e-4ab5-b75c-cad69e232a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdf8bfd-71a9-47ac-9253-943e5917656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:21 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Volume 6a82b601-adde-4285-95fc-949191f9d18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a82b601-adde-4285-95fc-949191f9d18c', 'volume_size': 1}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1352078317',display_name='tempest-VolumesGetTest-Volume-1225888969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a82b601-adde-4285-95fc-949191f9d18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:22Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Creating volume 6a82b601-adde-4285-95fc-949191f9d18c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:21 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "cinder-589550f7-8375-47b7-94be-1299484b2b90-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:21 devstack sudo[86151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c 1073741824
Apr 10 10:35:21 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-589550f7-8375-47b7-94be-1299484b2b90-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "cinder-quobyte-589550f7-8375-47b7-94be-1299484b2b90" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-quobyte-589550f7-8375-47b7-94be-1299484b2b90" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b70158-8e00-47a4-87bc-a951440c46b4]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:21 devstack sudo[86153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90
Apr 10 10:35:21 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:22 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c 1073741824" returned: 0 in 0.621s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:22 devstack sudo[86161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c
Apr 10 10:35:22 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:22 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90" returned: 0 in 0.581s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:22 devstack sudo[86163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90
Apr 10 10:35:22 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:22 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c" returned: 0 in 0.446s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdf8bfd-71a9-47ac-9253-943e5917656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a82b601-adde-4285-95fc-949191f9d18c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4a539c-09e2-4411-b93d-1e41ac3e36e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:22 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Volume volume-6a82b601-adde-4285-95fc-949191f9d18c (6a82b601-adde-4285-95fc-949191f9d18c): created successfully
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4a539c-09e2-4411-b93d-1e41ac3e36e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (f17ace8d-efe8-46d7-a370-96a162d8be28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:22 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bf46ab9c-ec35-4315-ac0c-bb7548d2215f tempest-VolumesGetTest-476577892 None] Created volume successfully.
Apr 10 10:35:22 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-589550f7-8375-47b7-94be-1299484b2b90" returned: 0 in 0.472s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-quobyte-589550f7-8375-47b7-94be-1299484b2b90" released by "delete_volume" :: held 1.081s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:22 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Created reservations ['a30ff914-129c-41f8-aec3-1683a0557041', 'bd626153-537e-4e00-8795-a9e7c7561768', '519614d1-8f3c-482d-b7b4-c115eb42a26e', '70dbc516-3be9-4868-881a-cc6e9d66a2cf'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:23 devstack sudo[86167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:23 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:23 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.465s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:23 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Deleted volume successfully.
Apr 10 10:35:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ba44fed9-04c7-4083-9907-cb8146585ef9 tempest-VolumesListAdminTestJSON-308634114 None] Lock "cinder-589550f7-8375-47b7-94be-1299484b2b90-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-6a82b601-adde-4285-95fc-949191f9d18c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Lock "cinder-6a82b601-adde-4285-95fc-949191f9d18c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-6a82b601-adde-4285-95fc-949191f9d18c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-6a82b601-adde-4285-95fc-949191f9d18c" acquired by "delete_volume" :: waited 0.036s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:24 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d745e66-7588-4768-ae6d-375a076ac47c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:24 devstack sudo[86199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c
Apr 10 10:35:24 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:25 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c" returned: 0 in 1.055s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:25 devstack sudo[86206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c
Apr 10 10:35:25 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:25 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6a82b601-adde-4285-95fc-949191f9d18c" returned: 0 in 0.652s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-6a82b601-adde-4285-95fc-949191f9d18c" released by "delete_volume" :: held 1.776s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Created reservations ['acd73919-6d29-46fc-a1b6-318a5d78aaae', '8aaf7221-786a-4b1b-aeba-496c958e66af', 'a4199825-9469-491e-97b8-65aa4d75d628', 'e70ba67b-17c6-4392-a428-d5d50da5ccfc'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:26 devstack sudo[86210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:26 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-60280f82-4625-47a4-a874-6af9ac295da0-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Lock "cinder-60280f82-4625-47a4-a874-6af9ac295da0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-60280f82-4625-47a4-a874-6af9ac295da0" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-60280f82-4625-47a4-a874-6af9ac295da0" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07179ce-18e6-4ebe-baaf-57b571c98e8e]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:26 devstack sudo[86212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0
Apr 10 10:35:26 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:26 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.920s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:26 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:27 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Deleted volume successfully.
Apr 10 10:35:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-955d55e0-656b-4c9d-a500-b5578230bfdb tempest-VolumesGetTest-476577892 None] Lock "cinder-6a82b601-adde-4285-95fc-949191f9d18c-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:27 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0" returned: 0 in 0.856s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:27 devstack sudo[86218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0
Apr 10 10:35:27 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:28 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-60280f82-4625-47a4-a874-6af9ac295da0" returned: 0 in 0.588s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-60280f82-4625-47a4-a874-6af9ac295da0" released by "delete_volume" :: held 1.497s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Created reservations ['d7d77622-0b29-4b7e-a2a4-531eccf9416d', 'a16976b1-26b3-40fe-b2cd-9e6db72529d5', '1268ff47-c471-45a9-b88f-329e47b20170', '1f6cea03-8bb5-49d7-b070-16bc52fef178'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:28 devstack sudo[86221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:28 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:29 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (1c5e70c8-e4dc-4b82-bb1d-b19a6ce99a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74957390-f8be-428a-9c98-d231f44de003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74957390-f8be-428a-9c98-d231f44de003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-683104446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e948823f-08f3-4243-b495-7fae3cb51f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:29Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8465a0-d045-461d-a8dc-d4c7e0877028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8465a0-d045-461d-a8dc-d4c7e0877028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb637297-b975-4d21-9b64-f7d2b3d8bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb637297-b975-4d21-9b64-f7d2b3d8bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e948823f-08f3-4243-b495-7fae3cb51f3c', 'volume_name': 'volume-e948823f-08f3-4243-b495-7fae3cb51f3c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a9f988-07ce-4440-aeac-371fe7d44476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a9f988-07ce-4440-aeac-371fe7d44476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abe2b6-393c-45b1-980c-5b76352256d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:29 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Volume e948823f-08f3-4243-b495-7fae3cb51f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e948823f-08f3-4243-b495-7fae3cb51f3c', 'volume_size': 1}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-683104446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e948823f-08f3-4243-b495-7fae3cb51f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:29Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Creating volume e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:29 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 1.294s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Deleted volume successfully.
Apr 10 10:35:29 devstack sudo[86225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c 1073741824
Apr 10 10:35:29 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-84ffa9e8-e1b4-4b56-bc0e-8b2e31534864 tempest-VolumesGetTest-476577892 None] Lock "cinder-60280f82-4625-47a4-a874-6af9ac295da0-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:30 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c 1073741824" returned: 0 in 0.947s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:30 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c
Apr 10 10:35:30 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:31 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c" returned: 0 in 0.877s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abe2b6-393c-45b1-980c-5b76352256d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e948823f-08f3-4243-b495-7fae3cb51f3c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80f4751-da93-4d9d-895a-96211788f3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:31 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Volume volume-e948823f-08f3-4243-b495-7fae3cb51f3c (e948823f-08f3-4243-b495-7fae3cb51f3c): created successfully
Apr 10 10:35:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80f4751-da93-4d9d-895a-96211788f3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (1c5e70c8-e4dc-4b82-bb1d-b19a6ce99a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7db9d1db-6aa9-4cd3-905d-ea720aab6a29 tempest-VolumesGetTest-476577892 None] Created volume successfully.
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (138cfe49-206b-43d6-80eb-70b9ce1d3a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fd1e18-8a37-4a73-9575-e0f91d2cf232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fd1e18-8a37-4a73-9575-e0f91d2cf232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19368772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c18600-a979-456e-8a92-edaf1ee71a14,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e948823f-08f3-4243-b495-7fae3cb51f3c,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:33Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2240b79-773c-4102-9f37-4a4e7898d90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2240b79-773c-4102-9f37-4a4e7898d90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4acb7c-8a86-4104-855d-1fc3d84bea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4acb7c-8a86-4104-855d-1fc3d84bea82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '28c18600-a979-456e-8a92-edaf1ee71a14', 'volume_name': 'volume-28c18600-a979-456e-8a92-edaf1ee71a14', 'volume_size': 1, 'source_volid': 'e948823f-08f3-4243-b495-7fae3cb51f3c', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb61898-7796-4082-8ffe-5f6aeb16f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb61898-7796-4082-8ffe-5f6aeb16f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb86b13-91cf-4ae9-a876-3a5e9648bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:33 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Volume 28c18600-a979-456e-8a92-edaf1ee71a14: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-28c18600-a979-456e-8a92-edaf1ee71a14', 'volume_size': 1, 'source_volid': 'e948823f-08f3-4243-b495-7fae3cb51f3c', 'source_volstatus': 'available'}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:33 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Cloning volume e948823f-08f3-4243-b495-7fae3cb51f3c to volume 28c18600-a979-456e-8a92-edaf1ee71a14
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Creating offline snapshot dba57bd8-4a77-4d50-80df-20e0cfbef659 of volume e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Acquiring lock "cinder-70540430-0757-4712-9d32-f4e97da1afee-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6e8af-63a7-4c5d-8a87-7804ab2a0fc0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "cinder-70540430-0757-4712-9d32-f4e97da1afee-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Acquiring lock "cinder-quobyte-70540430-0757-4712-9d32-f4e97da1afee" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "cinder-quobyte-70540430-0757-4712-9d32-f4e97da1afee" acquired by "delete_volume" :: waited 0.020s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:33 devstack sudo[86283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c
Apr 10 10:35:33 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72f131f-bd3d-410c-8b2c-6188620ac4aa]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:33 devstack sudo[86285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee
Apr 10 10:35:33 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:34 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c" returned: 0 in 0.836s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:34 devstack sudo[86294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 1G
Apr 10 10:35:34 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:34 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee" returned: 0 in 0.902s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:34 devstack sudo[86296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee
Apr 10 10:35:34 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:35 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-70540430-0757-4712-9d32-f4e97da1afee" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "cinder-quobyte-70540430-0757-4712-9d32-f4e97da1afee" released by "delete_volume" :: held 1.539s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Created reservations ['4088e108-6eeb-4662-8161-f8a83535fcfc', '4edc516e-3ccb-4046-b9fc-8481a9f1a7f1', '3b3c1215-474a-4e5f-984c-6c703566ad9f', '86c8f411-5137-4137-a2b6-db1de269a8ff'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:35 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:35 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:35 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 1G" returned: 0 in 1.072s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e948823f-08f3-4243-b495-7fae3cb51f3c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:35 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e948823f-08f3-4243-b495-7fae3cb51f3c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659
Apr 10 10:35:35 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:36 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.854s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Deleted volume successfully.
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2fbdb558-694b-48e3-87b5-d85ff2070202 tempest-ServerRescueNegativeTestJSON-1271329099 None] Lock "cinder-70540430-0757-4712-9d32-f4e97da1afee-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Flow 'volume_create_manager' (99652048-0014-426e-b808-36d95b365ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b75e825-fdad-4909-a5b8-117df893dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b75e825-fdad-4909-a5b8-117df893dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1423882822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3f53a2-206b-4a82-8856-148edef8a848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20568ab307c4d5bbc2453e7f0830c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:36Z,use_quota=True,user_id='e057e8bdba014756abbcb7a84583e7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91dbf17-f5b1-4659-bf4a-40695a1f09ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91dbf17-f5b1-4659-bf4a-40695a1f09ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937c3d86-4546-4a4a-80fd-b8f87b357901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937c3d86-4546-4a4a-80fd-b8f87b357901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3f53a2-206b-4a82-8856-148edef8a848', 'volume_name': 'volume-7d3f53a2-206b-4a82-8856-148edef8a848', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0a2ef4-71e2-4b19-a278-ba0c761b92c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0a2ef4-71e2-4b19-a278-ba0c761b92c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf13bf3-57be-4403-9dac-f0a7dd31e526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:36 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Volume 7d3f53a2-206b-4a82-8856-148edef8a848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3f53a2-206b-4a82-8856-148edef8a848', 'volume_size': 1}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:36 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e948823f-08f3-4243-b495-7fae3cb51f3c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659" returned: 0 in 1.107s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:36 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 is being set with open permissions: ugo+rw
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:36 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659
Apr 10 10:35:36 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:36 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659" returned: 0 in 0.498s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:37 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.info
Apr 10 10:35:37 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:37 devstack sudo[86358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:37 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:37 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.info" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:37 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.info is being set with open permissions: ugo+rw
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:37 devstack sudo[86361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.info
Apr 10 10:35:37 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:37 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.495s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:37 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:38 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.info" returned: 0 in 0.482s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-28c18600-a979-456e-8a92-edaf1ee71a14" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-28c18600-a979-456e-8a92-edaf1ee71a14" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] snapshot: dba57bd8-4a77-4d50-80df-20e0cfbef659, volume: 28c18600-a979-456e-8a92-edaf1ee71a14,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ae2ad8-5140-463a-8fcb-7f7559c637e8]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:38 devstack sudo[86365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659
Apr 10 10:35:38 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:38 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659" returned: 0 in 0.597s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e948823f-08f3-4243-b495-7fae3cb51f3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d945121-e714-4377-83b0-4fd54e41cdaf]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:38 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c
Apr 10 10:35:38 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:39 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c" returned: 0 in 0.526s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:39 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:35:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:39 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14
Apr 10 10:35:39 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:41 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14" returned: 0 in 2.554s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:41 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a757468e-b088-4497-a250-533b67ab3b09]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:41 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c
Apr 10 10:35:41 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:42 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c" returned: 0 in 0.664s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:35:42 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Converted 1024.00 MB image at 400.75 MB/s
Apr 10 10:35:42 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14 is being set with open permissions: ugo+rw
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:42 devstack sudo[86394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14
Apr 10 10:35:42 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:42 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14" returned: 0 in 0.463s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-28c18600-a979-456e-8a92-edaf1ee71a14" released by "_copy_volume_from_snapshot" :: held 4.875s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-dba57bd8-4a77-4d50-80df-20e0cfbef659" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-dba57bd8-4a77-4d50-80df-20e0cfbef659" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Deleting offline snapshot dba57bd8-4a77-4d50-80df-20e0cfbef659 of volume e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] snapshot_file for this snap is: volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4924280b-80e2-4346-983e-6caf6521b032]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:43 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659
Apr 10 10:35:43 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:43 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659" returned: 0 in 0.532s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e948823f-08f3-4243-b495-7fae3cb51f3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:35:43 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54ce51c-077f-4275-a737-435557dfa79b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:43 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c
Apr 10 10:35:43 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:44 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c" returned: 0 in 0.515s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:44 devstack sudo[86407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659
Apr 10 10:35:44 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:44 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659" returned: 0 in 0.538s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:44 devstack sudo[86440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659
Apr 10 10:35:44 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:45 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c.dba57bd8-4a77-4d50-80df-20e0cfbef659" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-dba57bd8-4a77-4d50-80df-20e0cfbef659" released by "_delete_snapshot" :: held 2.146s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.789s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.914s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1423882822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3f53a2-206b-4a82-8856-148edef8a848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20568ab307c4d5bbc2453e7f0830c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:36Z,use_quota=True,user_id='e057e8bdba014756abbcb7a84583e7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Creating volume 7d3f53a2-206b-4a82-8856-148edef8a848 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:45 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb86b13-91cf-4ae9-a876-3a5e9648bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c18600-a979-456e-8a92-edaf1ee71a14', 'volume_size': 1, 'source_volid': 'e948823f-08f3-4243-b495-7fae3cb51f3c', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:45 devstack sudo[86445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848 1073741824
Apr 10 10:35:45 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f66a94-b11e-40fd-986e-7e0781ef2017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:45 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Volume volume-28c18600-a979-456e-8a92-edaf1ee71a14 (28c18600-a979-456e-8a92-edaf1ee71a14): created successfully
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f66a94-b11e-40fd-986e-7e0781ef2017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (138cfe49-206b-43d6-80eb-70b9ce1d3a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:45 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7bc663da-8206-431b-b3e2-f13c3c46ea61 tempest-VolumesGetTest-476577892 None] Created volume successfully.
Apr 10 10:35:45 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848 1073741824" returned: 0 in 0.611s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:45 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848
Apr 10 10:35:45 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:46 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848" returned: 0 in 0.673s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf13bf3-57be-4403-9dac-f0a7dd31e526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3f53a2-206b-4a82-8856-148edef8a848', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250ce8e9-1084-4f72-a678-284ea9f70478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:46 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Volume volume-7d3f53a2-206b-4a82-8856-148edef8a848 (7d3f53a2-206b-4a82-8856-148edef8a848): created successfully
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250ce8e9-1084-4f72-a678-284ea9f70478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Flow 'volume_create_manager' (99652048-0014-426e-b808-36d95b365ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-97414844-76f4-4653-87a3-3286f10cf568 tempest-VolumesTransfersTest-1289174199 None] Created volume successfully.
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (48301b32-77d9-4fa8-aa4c-e23be6642129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3711c820-30e6-4967-82e0-64f819c809ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3711c820-30e6-4967-82e0-64f819c809ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1056433156',display_name='tempest-VolumesGetTest-Volume-35018040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3563934-534f-4616-85ab-4090df5ddf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:47Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e838f991-b705-4a2f-8569-11a81687af6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e838f991-b705-4a2f-8569-11a81687af6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981e8578-2153-461a-9090-f8dc6d764c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981e8578-2153-461a-9090-f8dc6d764c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3563934-534f-4616-85ab-4090df5ddf3a', 'volume_name': 'volume-d3563934-534f-4616-85ab-4090df5ddf3a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5147e4c1-d59f-4d41-ad5e-13885a11a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5147e4c1-d59f-4d41-ad5e-13885a11a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcc6d22-7e8b-42b2-92fe-2b0c1f7c7ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:46 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Volume d3563934-534f-4616-85ab-4090df5ddf3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3563934-534f-4616-85ab-4090df5ddf3a', 'volume_size': 1}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1056433156',display_name='tempest-VolumesGetTest-Volume-35018040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3563934-534f-4616-85ab-4090df5ddf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:47Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Creating volume d3563934-534f-4616-85ab-4090df5ddf3a {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:46 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:46 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a 1073741824
Apr 10 10:35:46 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:47 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-93d6867d-52de-46f4-9edf-e9bccd2bae70 tempest-VolumesTransfersTest-2024337317 None] Transfer volume completed successfully.
Apr 10 10:35:47 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a 1073741824" returned: 0 in 0.619s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:47 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a
Apr 10 10:35:47 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:47 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a" returned: 0 in 0.456s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcc6d22-7e8b-42b2-92fe-2b0c1f7c7ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3563934-534f-4616-85ab-4090df5ddf3a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895bbcf7-eb34-4fa5-a9cd-aa66b6e692c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:47 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Volume volume-d3563934-534f-4616-85ab-4090df5ddf3a (d3563934-534f-4616-85ab-4090df5ddf3a): created successfully
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895bbcf7-eb34-4fa5-a9cd-aa66b6e692c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (48301b32-77d9-4fa8-aa4c-e23be6642129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:47 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-42a49706-c8f1-40f1-bf32-930c79e08e38 tempest-VolumesGetTest-476577892 None] Created volume successfully.
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Acquiring lock "cinder-7d3f53a2-206b-4a82-8856-148edef8a848-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-7d3f53a2-206b-4a82-8856-148edef8a848-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Acquiring lock "cinder-quobyte-7d3f53a2-206b-4a82-8856-148edef8a848" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-quobyte-7d3f53a2-206b-4a82-8856-148edef8a848" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736ca84-756a-4ea0-9355-0cb14ac361b2]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:48 devstack sudo[86466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848
Apr 10 10:35:48 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:48 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848" returned: 0 in 0.560s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:48 devstack sudo[86471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848
Apr 10 10:35:48 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-d3563934-534f-4616-85ab-4090df5ddf3a-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Lock "cinder-d3563934-534f-4616-85ab-4090df5ddf3a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-d3563934-534f-4616-85ab-4090df5ddf3a" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-d3563934-534f-4616-85ab-4090df5ddf3a" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c88b92-c309-42e0-a522-337e412379b2]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:49 devstack sudo[86479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a
Apr 10 10:35:49 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:49 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7d3f53a2-206b-4a82-8856-148edef8a848" returned: 0 in 0.500s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-quobyte-7d3f53a2-206b-4a82-8856-148edef8a848" released by "delete_volume" :: held 1.089s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Created reservations ['22c947c4-815d-42e0-8a15-812dbedef98e', '35a3a71f-a4b6-4540-aa06-6263ee5e9477', '8f3fcfec-0dd9-4ce0-b2f6-e97305b5660e', '59909101-5242-4b8f-b325-5961ab0b552a'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:49 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:49 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:49 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a" returned: 0 in 0.582s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:49 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a
Apr 10 10:35:49 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:49 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.454s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:49 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Deleted volume successfully.
Apr 10 10:35:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c303754-e623-4628-975c-477147d8b986 tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-7d3f53a2-206b-4a82-8856-148edef8a848-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:50 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d3563934-534f-4616-85ab-4090df5ddf3a" returned: 0 in 0.454s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-d3563934-534f-4616-85ab-4090df5ddf3a" released by "delete_volume" :: held 1.067s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Created reservations ['b2c59f0f-2082-4207-88a1-593a6f8c3a66', '726f5891-1dae-4cde-8d17-c7b212afdcab', '63f9e45a-68dc-4554-8ebd-a9c441b9e441', '236e0185-7213-4468-ad83-2d377889e5f0'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:50 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:50 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:50 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.487s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:50 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Deleted volume successfully.
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ff729403-dd55-473e-9324-dc4e6f8a81ff tempest-VolumesGetTest-476577892 None] Lock "cinder-d3563934-534f-4616-85ab-4090df5ddf3a-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Flow 'volume_create_manager' (431b758e-5240-4d86-bf87-5992ee13ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81810996-810b-455c-9c49-4f8a10e290d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81810996-810b-455c-9c49-4f8a10e290d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1225084161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20568ab307c4d5bbc2453e7f0830c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:51Z,use_quota=True,user_id='e057e8bdba014756abbcb7a84583e7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1673eae-1e2c-4149-8cc4-5ecbcbfc6985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1673eae-1e2c-4149-8cc4-5ecbcbfc6985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26854354-f7bf-49b9-ab9c-f77096e0e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26854354-f7bf-49b9-ab9c-f77096e0e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad', 'volume_name': 'volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973656ce-5b73-465d-9e90-f3d6ab252c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973656ce-5b73-465d-9e90-f3d6ab252c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2bd149-4921-4a93-b3b2-9f0528a0b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:50 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Volume bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad', 'volume_size': 1}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1225084161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20568ab307c4d5bbc2453e7f0830c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:51Z,use_quota=True,user_id='e057e8bdba014756abbcb7a84583e7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Creating volume bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:50 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:50 devstack sudo[86495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad 1073741824
Apr 10 10:35:50 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-28c18600-a979-456e-8a92-edaf1ee71a14-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Lock "cinder-28c18600-a979-456e-8a92-edaf1ee71a14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-28c18600-a979-456e-8a92-edaf1ee71a14" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-28c18600-a979-456e-8a92-edaf1ee71a14" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5312c9-4c0b-4832-98f9-783028df5483]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:51 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14
Apr 10 10:35:51 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:51 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad 1073741824" returned: 0 in 0.680s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:51 devstack sudo[86502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad
Apr 10 10:35:51 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:51 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14" returned: 0 in 0.627s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:51 devstack sudo[86507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14
Apr 10 10:35:51 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:52 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad" returned: 0 in 0.525s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2bd149-4921-4a93-b3b2-9f0528a0b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4766e12-57ad-4c1f-b34b-9b840bcafefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:52 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Volume volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad (bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad): created successfully
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4766e12-57ad-4c1f-b34b-9b840bcafefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Flow 'volume_create_manager' (431b758e-5240-4d86-bf87-5992ee13ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-015e7223-ae39-4c76-b089-82f758dd30b4 tempest-VolumesTransfersTest-1289174199 None] Created volume successfully.
Apr 10 10:35:52 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-28c18600-a979-456e-8a92-edaf1ee71a14" returned: 0 in 0.545s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-28c18600-a979-456e-8a92-edaf1ee71a14" released by "delete_volume" :: held 1.200s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Created reservations ['443d90d9-597f-4598-ac30-1ba59c505c56', 'ccb23f4a-8c8a-4088-a242-edc9edab5d3e', '9dd3cf0b-300c-470d-a907-b16ff31cb75f', '82be2c66-9257-4930-8d73-7231a845b4c3'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:52 devstack sudo[86512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:52 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:53 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.477s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:53 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Deleted volume successfully.
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-29d9c828-3501-4469-ad2e-9a6e48a2db1b tempest-VolumesGetTest-476577892 None] Lock "cinder-28c18600-a979-456e-8a92-edaf1ee71a14-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Acquiring lock "cinder-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Acquiring lock "cinder-quobyte-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-quobyte-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad" acquired by "delete_volume" :: waited 0.018s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e0329-281e-4546-964a-e7626b73631b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:53 devstack sudo[86515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad
Apr 10 10:35:53 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-e948823f-08f3-4243-b495-7fae3cb51f3c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Lock "cinder-e948823f-08f3-4243-b495-7fae3cb51f3c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-e948823f-08f3-4243-b495-7fae3cb51f3c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-e948823f-08f3-4243-b495-7fae3cb51f3c" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc07a3-40f0-42ab-b6a5-af7e0f774e08]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:53 devstack sudo[86517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c
Apr 10 10:35:53 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:53 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad" returned: 0 in 0.594s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:53 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad
Apr 10 10:35:53 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:54 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c" returned: 0 in 0.641s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:54 devstack sudo[86528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c
Apr 10 10:35:54 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:54 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-quobyte-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad" released by "delete_volume" :: held 1.174s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=83,cinder:UPDATE=128,cinder:DELETE=13,cinder:INSERT=30 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=94,cinder:UPDATE=128,cinder:INSERT=28,cinder:DELETE=10 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Created reservations ['95759292-d0dd-4ed2-8398-fe541ab61e8c', '33052991-d43f-4186-b620-b22ca22cbe90', 'f5cf1697-3d09-487f-9696-427fa5220cab', '1bef22bd-dfe3-4177-8bee-c758751aa239'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:54 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:54 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:54 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e948823f-08f3-4243-b495-7fae3cb51f3c" returned: 0 in 0.552s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-e948823f-08f3-4243-b495-7fae3cb51f3c" released by "delete_volume" :: held 1.243s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Created reservations ['c4fb77fe-3eac-4ed5-b252-181ef1f17ffb', 'd848bcf5-fd50-4a01-b45b-2602ccf5d890', 'd5c47ea4-1233-41f7-983e-d7871bd31c07', '4362ec5c-7ecc-4f59-ad24-6db74ee27049'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:54 devstack sudo[86534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:35:54 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:55 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:55 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Deleted volume successfully.
Apr 10 10:35:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11242e04-49f4-4d38-86a3-7d5e0f40337e tempest-VolumesTransfersTest-1891109022 None] Lock "cinder-bf85caa5-eaf4-464c-a5da-4e1bb0ba02ad-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:55 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.503s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:55 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:35:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Deleted volume successfully.
Apr 10 10:35:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-92870a95-8df4-4b64-be72-c11a302087ce tempest-VolumesGetTest-476577892 None] Lock "cinder-e948823f-08f3-4243-b495-7fae3cb51f3c-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (3b475a9b-4468-44f6-b344-76dc84ad9c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381d3f5-84a7-4d62-bf71-982ffe2ae007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381d3f5-84a7-4d62-bf71-982ffe2ae007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-456957974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c722b99c-1d76-44a0-9a64-4a63b819f621,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:56Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088acee8-8189-44af-ac23-f4e5e4819867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088acee8-8189-44af-ac23-f4e5e4819867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70c1be4-0d13-4686-8b97-c8854e6ed737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.image.glance [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Creating Keystone auth plugin from conf {{(pid=81969) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70c1be4-0d13-4686-8b97-c8854e6ed737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c722b99c-1d76-44a0-9a64-4a63b819f621', 'volume_name': 'volume-c722b99c-1d76-44a0-9a64-4a63b819f621', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d80af820>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffa9c11-edce-4fc8-af5a-6f65b7e5b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffa9c11-edce-4fc8-af5a-6f65b7e5b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7680373-41ca-450b-8878-b11a65e13a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:35:56 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Volume c722b99c-1d76-44a0-9a64-4a63b819f621: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c722b99c-1d76-44a0-9a64-4a63b819f621', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d80af820>}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Trying to clone c722b99c-1d76-44a0-9a64-4a63b819f621 from image 2fe75249-df95-461c-a1b7-506809038618 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]). {{(pid=81969) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 10:35:56 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1bb9a7-7745-4303-9eac-79e4a31cc5dc]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:56 devstack sudo[86539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD
Apr 10 10:35:56 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:57 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD" returned: 0 in 0.628s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:57 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 is fetched for user 2e5a0f2a18354bd2bbe93a20ef834b84. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 10:35:57 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3ca2e3-f756-4e4e-8917-fee9277ec432]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:57 devstack sudo[86578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD
Apr 10 10:35:57 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:58 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD" returned: 0 in 0.585s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-456957974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c722b99c-1d76-44a0-9a64-4a63b819f621,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:56Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Creating volume c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:35:58 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:58 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 1073741824
Apr 10 10:35:58 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:58 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 1073741824" returned: 0 in 0.729s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:58 devstack sudo[86588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621
Apr 10 10:35:58 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:35:59 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root
Apr 10 10:35:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621" returned: 0 in 0.648s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:35:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:35:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:35:59 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Attempting download of 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume c722b99c-1d76-44a0-9a64-4a63b819f621. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 10:35:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd49ca1-dd3e-4e8c-a337-9c3567df4d3d]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:35:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_29i8y946 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:35:59 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_29i8y946
Apr 10 10:35:59 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:00 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_29i8y946" returned: 0 in 0.653s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_29i8y946 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:00 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_29i8y946
Apr 10 10:36:00 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:00 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_29i8y946" returned: 1 in 0.646s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe75249-df95-461c-a1b7-506809038618_29i8y946' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:36:00 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca3e3c-4dde-45a7-9bf8-2b216f7da5d0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:00 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD
Apr 10 10:36:00 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Flow 'volume_create_manager' (8f6ed309-bb22-4067-94ae-14fe224a1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4b8746-5a8e-458c-9cf6-c28959955a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4b8746-5a8e-458c-9cf6-c28959955a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-515504498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b3c041-982a-4cf2-9c88-3691569e4dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331d633ce3864ccab27224525dc8acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:01Z,use_quota=True,user_id='3e3627869ecd48f5b1c01033d7d5d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd82cd95-5be5-454f-b6d7-f940648456f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd82cd95-5be5-454f-b6d7-f940648456f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3525fa50-79a1-48cd-9734-59d73c2f1bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3525fa50-79a1-48cd-9734-59d73c2f1bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b3c041-982a-4cf2-9c88-3691569e4dc0', 'volume_name': 'volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be79c24-ce49-4520-9395-322b4d7f3866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be79c24-ce49-4520-9395-322b4d7f3866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e46ba9a-449e-4a3d-98fe-9bf505b40119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:01 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Volume b4b3c041-982a-4cf2-9c88-3691569e4dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0', 'volume_size': 1}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-515504498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b3c041-982a-4cf2-9c88-3691569e4dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331d633ce3864ccab27224525dc8acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:01Z,use_quota=True,user_id='3e3627869ecd48f5b1c01033d7d5d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Creating volume b4b3c041-982a-4cf2-9c88-3691569e4dc0 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:01 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:01 devstack sudo[86605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0 1073741824
Apr 10 10:36:01 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:01 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] 2fe75249-df95-461c-a1b7-506809038618 was qcow2, converting to raw {{(pid=81969) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 10:36:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:01 devstack sudo[86607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621
Apr 10 10:36:01 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:02 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0 1073741824" returned: 0 in 0.673s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:02 devstack sudo[86617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0
Apr 10 10:36:02 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:02 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0" returned: 0 in 0.620s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e46ba9a-449e-4a3d-98fe-9bf505b40119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e56a2ab-dd0f-4ace-9a67-1718c5a57978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:02 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Volume volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0 (b4b3c041-982a-4cf2-9c88-3691569e4dc0): created successfully
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e56a2ab-dd0f-4ace-9a67-1718c5a57978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Flow 'volume_create_manager' (8f6ed309-bb22-4067-94ae-14fe224a1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:02 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9248ee27-ebd0-4f69-b597-1643a22fb87c tempest-VolumesTransfersV355Test-1854804422 None] Created volume successfully.
Apr 10 10:36:02 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621" returned: 0 in 1.339s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fe75249-df95-461c-a1b7-506809038618_82qw_zajdevstack@QuobyteHD, size 112.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:36:02 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Converted 112.00 MB image at 83.62 MB/s
Apr 10 10:36:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:02 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 1G
Apr 10 10:36:02 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:03 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 1G" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:03 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e71972-60c0-4044-86f4-dd8bdc9bf184]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:03 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621
Apr 10 10:36:03 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:04 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621" returned: 0 in 0.683s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:04 devstack sudo[86629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621
Apr 10 10:36:04 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:04 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-63a00660-e486-487d-ab7f-b16feef6af1d tempest-VolumesTransfersV355Test-843147819 None] Transfer volume completed successfully.
Apr 10 10:36:04 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621" returned: 1 in 0.595s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Downloaded image 2fe75249-df95-461c-a1b7-506809038618 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}])) to volume c722b99c-1d76-44a0-9a64-4a63b819f621 successfully. {{(pid=81969) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Temporary image 2fe75249-df95-461c-a1b7-506809038618 for user 2e5a0f2a18354bd2bbe93a20ef834b84 is deleted. {{(pid=81969) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.volume_utils [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Marking volume c722b99c-1d76-44a0-9a64-4a63b819f621 as bootable. {{(pid=81969) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Copying metadata from image 2fe75249-df95-461c-a1b7-506809038618 to c722b99c-1d76-44a0-9a64-4a63b819f621. {{(pid=81969) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Creating volume glance metadata for volume c722b99c-1d76-44a0-9a64-4a63b819f621 backed by image 2fe75249-df95-461c-a1b7-506809038618 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81969) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7680373-41ca-450b-8878-b11a65e13a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c722b99c-1d76-44a0-9a64-4a63b819f621', 'volume_size': 1, 'image_id': '2fe75249-df95-461c-a1b7-506809038618', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe75249-df95-461c-a1b7-506809038618', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddea330b52c4aeeb584fc73c84e5f1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fe75249-df95-461c-a1b7-506809038618', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe75249-df95-461c-a1b7-506809038618/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f78d80af820>}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7803f-17d1-4d30-91f7-2bd85f43988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:04 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Volume volume-c722b99c-1d76-44a0-9a64-4a63b819f621 (c722b99c-1d76-44a0-9a64-4a63b819f621): created successfully
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7803f-17d1-4d30-91f7-2bd85f43988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (3b475a9b-4468-44f6-b344-76dc84ad9c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:04 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-57fa327b-a98c-41c8-aa27-148561a6714e tempest-VolumesGetTest-476577892 None] Created volume successfully.
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Acquiring lock "cinder-b4b3c041-982a-4cf2-9c88-3691569e4dc0-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-b4b3c041-982a-4cf2-9c88-3691569e4dc0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Acquiring lock "cinder-quobyte-b4b3c041-982a-4cf2-9c88-3691569e4dc0" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-quobyte-b4b3c041-982a-4cf2-9c88-3691569e4dc0" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd4c062-806a-407b-b96c-bb00b98057bd]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:05 devstack sudo[86634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0
Apr 10 10:36:05 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:05 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0" returned: 0 in 0.608s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:05 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0
Apr 10 10:36:05 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (ee6217c9-99e2-4678-8865-0747dc944c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3b7737-edc4-45b3-b0ee-426687bf2c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3b7737-edc4-45b3-b0ee-426687bf2c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-481381149',display_name='tempest-VolumesGetTest-Volume-1913172674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b900d905-ae72-4b15-9d5e-0e807260c149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:06Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fff94e-745c-4c8b-bbfb-5772e03b6465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fff94e-745c-4c8b-bbfb-5772e03b6465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c0cd36-0b12-4d11-beb5-f662109a36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c0cd36-0b12-4d11-beb5-f662109a36f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b900d905-ae72-4b15-9d5e-0e807260c149', 'volume_name': 'volume-b900d905-ae72-4b15-9d5e-0e807260c149', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c967b6b0-b9be-4997-857c-322c61f589e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c967b6b0-b9be-4997-857c-322c61f589e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64ddd8-09ef-4b66-aafd-89110a18bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Volume b900d905-ae72-4b15-9d5e-0e807260c149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b900d905-ae72-4b15-9d5e-0e807260c149', 'volume_size': 1}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-481381149',display_name='tempest-VolumesGetTest-Volume-1913172674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b900d905-ae72-4b15-9d5e-0e807260c149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d62ac335faf4793999b3ddb2e5ff6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:06Z,use_quota=True,user_id='2e5a0f2a18354bd2bbe93a20ef834b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Creating volume b900d905-ae72-4b15-9d5e-0e807260c149 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:06 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:06 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149 1073741824
Apr 10 10:36:06 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Flow 'volume_create_manager' (b2f7a6c6-dc88-4957-9fac-428d6e813bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd8d60d-eb48-4941-b862-6070933f8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd8d60d-eb48-4941-b862-6070933f8739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-476948475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87685e04-1db5-4330-a9d6-d19fd518d582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc6424ae26d4da58b01fe0926c96161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:06Z,use_quota=True,user_id='97c4d09a63a14581b5953b82b79c0d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1691b1-8b72-4827-a371-21606620391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1691b1-8b72-4827-a371-21606620391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243c4c33-806c-4e8e-be57-39fe919b642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243c4c33-806c-4e8e-be57-39fe919b642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87685e04-1db5-4330-a9d6-d19fd518d582', 'volume_name': 'volume-87685e04-1db5-4330-a9d6-d19fd518d582', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5610ce7d-1514-40c7-980d-579461e4fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5610ce7d-1514-40c7-980d-579461e4fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab9fec0-a42f-429b-b350-823c1bd7dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:06 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Volume 87685e04-1db5-4330-a9d6-d19fd518d582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87685e04-1db5-4330-a9d6-d19fd518d582', 'volume_size': 1}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:06 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b4b3c041-982a-4cf2-9c88-3691569e4dc0" returned: 0 in 0.534s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-quobyte-b4b3c041-982a-4cf2-9c88-3691569e4dc0" released by "delete_volume" :: held 1.175s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Created reservations ['a09f4e9d-c939-4ee4-bb45-3c0947e56cf6', '8625c363-d9d1-4422-b47f-2152702dedc4', '93f0cdd7-089d-40bf-9f5a-ccb180775d5b', 'b315686d-c240-407f-9368-308fb6c79838'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:06 devstack sudo[86645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:06 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:07 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.449s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:07 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Deleted volume successfully.
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ed5784a8-ff28-41d7-8e64-9fc3ffece9f2 tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-b4b3c041-982a-4cf2-9c88-3691569e4dc0-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:07 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149 1073741824" returned: 0 in 0.711s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:07 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149
Apr 10 10:36:07 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:07 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149" returned: 0 in 0.476s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-476948475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87685e04-1db5-4330-a9d6-d19fd518d582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc6424ae26d4da58b01fe0926c96161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:06Z,use_quota=True,user_id='97c4d09a63a14581b5953b82b79c0d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Creating volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:07 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64ddd8-09ef-4b66-aafd-89110a18bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b900d905-ae72-4b15-9d5e-0e807260c149', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:07 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 1073741824
Apr 10 10:36:07 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c04cb8c-8f8f-4136-88b5-a692a9d12e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:07 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Volume volume-b900d905-ae72-4b15-9d5e-0e807260c149 (b900d905-ae72-4b15-9d5e-0e807260c149): created successfully
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c04cb8c-8f8f-4136-88b5-a692a9d12e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Flow 'volume_create_manager' (ee6217c9-99e2-4678-8865-0747dc944c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:07 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-586c2821-a033-489b-8e9e-90f7f2f73a8f tempest-VolumesGetTest-476577892 None] Created volume successfully.
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Flow 'volume_create_manager' (cda86337-accd-42b2-b316-fd58266edf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cd7226-183c-4f44-a40c-93895e625bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cd7226-183c-4f44-a40c-93895e625bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-963604686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6741962-3f66-42a1-a2c6-32472f16b378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331d633ce3864ccab27224525dc8acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:08Z,use_quota=True,user_id='3e3627869ecd48f5b1c01033d7d5d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad20979-6b75-4c55-b69f-5e60f6de4e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad20979-6b75-4c55-b69f-5e60f6de4e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa79a10e-2e61-402b-b716-487edb18fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa79a10e-2e61-402b-b716-487edb18fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6741962-3f66-42a1-a2c6-32472f16b378', 'volume_name': 'volume-f6741962-3f66-42a1-a2c6-32472f16b378', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5d6b2-b9a6-4c37-b626-a11646ea036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5d6b2-b9a6-4c37-b626-a11646ea036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058a9c3c-060d-4fa3-902b-3a0a7ceaeda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:07 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Volume f6741962-3f66-42a1-a2c6-32472f16b378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6741962-3f66-42a1-a2c6-32472f16b378', 'volume_size': 1}
Apr 10 10:36:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:08 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 1073741824" returned: 0 in 0.518s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:08 devstack sudo[86659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582
Apr 10 10:36:08 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-b900d905-ae72-4b15-9d5e-0e807260c149-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Lock "cinder-b900d905-ae72-4b15-9d5e-0e807260c149-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-b900d905-ae72-4b15-9d5e-0e807260c149" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-b900d905-ae72-4b15-9d5e-0e807260c149" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c6623-faf2-4a9f-8dba-01470fcf4e53]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:08 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582" returned: 0 in 0.543s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-963604686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6741962-3f66-42a1-a2c6-32472f16b378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331d633ce3864ccab27224525dc8acc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:08Z,use_quota=True,user_id='3e3627869ecd48f5b1c01033d7d5d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Creating volume f6741962-3f66-42a1-a2c6-32472f16b378 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:08 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab9fec0-a42f-429b-b350-823c1bd7dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87685e04-1db5-4330-a9d6-d19fd518d582', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6444b32-ee20-424a-9d02-0b81cc127abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:08 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378 1073741824
Apr 10 10:36:08 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:08 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Volume volume-87685e04-1db5-4330-a9d6-d19fd518d582 (87685e04-1db5-4330-a9d6-d19fd518d582): created successfully
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6444b32-ee20-424a-9d02-0b81cc127abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:08 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Flow 'volume_create_manager' (b2f7a6c6-dc88-4957-9fac-428d6e813bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:08 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149
Apr 10 10:36:08 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:08 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-86f43fef-124f-4cb8-9cba-d2e286332d68 tempest-SnapshotsActionsTest-619975053 None] Created volume successfully.
Apr 10 10:36:09 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149" returned: 0 in 0.628s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:09 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149
Apr 10 10:36:09 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:09 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378 1073741824" returned: 0 in 0.723s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:09 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378
Apr 10 10:36:09 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:09 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b900d905-ae72-4b15-9d5e-0e807260c149" returned: 0 in 0.668s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-b900d905-ae72-4b15-9d5e-0e807260c149" released by "delete_volume" :: held 1.325s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:09 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Created reservations ['f7003d35-e800-460f-8591-bcd71a187a98', '2f10b44d-5743-4d3a-9096-e03c711f3663', 'f1a9bed6-ea61-4ffb-9b8a-0ca6c792c212', '71f72020-c59f-4556-90e6-0127e3a74f92'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:10 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:10 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:10 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378" returned: 0 in 0.692s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.291s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Creating offline snapshot 528577bd-4be7-402c-8c73-d987238c2c6f of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058a9c3c-060d-4fa3-902b-3a0a7ceaeda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6741962-3f66-42a1-a2c6-32472f16b378', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a563b579-17fd-474e-8c74-d7c2de9277e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd5218-7fe1-43f8-b417-949a10d84317]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:10 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Volume volume-f6741962-3f66-42a1-a2c6-32472f16b378 (f6741962-3f66-42a1-a2c6-32472f16b378): created successfully
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a563b579-17fd-474e-8c74-d7c2de9277e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Flow 'volume_create_manager' (cda86337-accd-42b2-b316-fd58266edf60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:10 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c8c0a70d-aff2-454f-a99f-d326276eb83e tempest-VolumesTransfersV355Test-1854804422 None] Created volume successfully.
Apr 10 10:36:10 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582
Apr 10 10:36:10 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:10 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.538s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:10 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Deleted volume successfully.
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-566ef4d7-6cb9-41fd-bfc2-d235b7e46e57 tempest-VolumesGetTest-476577892 None] Lock "cinder-b900d905-ae72-4b15-9d5e-0e807260c149-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:10 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582" returned: 0 in 0.594s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:10 devstack sudo[86687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f 1G
Apr 10 10:36:10 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-c722b99c-1d76-44a0-9a64-4a63b819f621-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Lock "cinder-c722b99c-1d76-44a0-9a64-4a63b819f621-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Acquiring lock "cinder-quobyte-c722b99c-1d76-44a0-9a64-4a63b819f621" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-c722b99c-1d76-44a0-9a64-4a63b819f621" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c3c7ce-81c3-4950-a187-4a9c13e478bd]: (4, 'raw') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:11 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621
Apr 10 10:36:11 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Acquiring lock "cinder-f6741962-3f66-42a1-a2c6-32472f16b378-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-f6741962-3f66-42a1-a2c6-32472f16b378-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Acquiring lock "cinder-quobyte-f6741962-3f66-42a1-a2c6-32472f16b378" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-quobyte-f6741962-3f66-42a1-a2c6-32472f16b378" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[73301106-c4c1-4175-a3f2-df537401a65a]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:11 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f 1G" returned: 0 in 0.667s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:11 devstack sudo[86695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:11 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:11 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378
Apr 10 10:36:11 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:11 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621" returned: 0 in 0.659s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:11 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621
Apr 10 10:36:11 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:11 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378" returned: 0 in 0.582s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:11 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:11 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f is being set with open permissions: ugo+rw
Apr 10 10:36:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:11 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378
Apr 10 10:36:11 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:12 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:12 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:12 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621" returned: 1 in 0.584s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621' failed. Not Retrying. {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:12 devstack sudo[86715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621
Apr 10 10:36:12 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:12 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f6741962-3f66-42a1-a2c6-32472f16b378" returned: 0 in 0.473s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-quobyte-f6741962-3f66-42a1-a2c6-32472f16b378" released by "delete_volume" :: held 1.082s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:12 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.474s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:12 devstack sudo[86719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.info
Apr 10 10:36:12 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Created reservations ['483a8acb-a028-4a92-b8a7-5c9af3a98e62', '9726be42-c667-49c9-ab63-253fd348cbf3', 'c38adeb8-c7e0-40d3-96fd-1cbd47ed99db', '45bdc301-94a9-4c17-9f3a-35b0829d35b1'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:12 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:12 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:12 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c722b99c-1d76-44a0-9a64-4a63b819f621" returned: 0 in 0.437s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Lock "cinder-quobyte-c722b99c-1d76-44a0-9a64-4a63b819f621" released by "delete_volume" :: held 1.735s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Created reservations ['6c66094e-1154-47b6-a105-ec03488ffe58', '10f64a47-43f7-400f-b590-058be2f9f616', 'd31130d1-0acd-4ea5-858c-68b29ffb1275', '4f195ad7-1da8-4609-8fb9-90a2b6279b34'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:12 devstack sudo[86724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:12 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:12 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.info" returned: 0 in 0.463s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:12 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.info is being set with open permissions: ugo+rw
Apr 10 10:36:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:12 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.info
Apr 10 10:36:12 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:13 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.467s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:13 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Deleted volume successfully.
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7a228d69-d759-4487-8be2-70bb73bdb5dd tempest-VolumesTransfersV355Test-1540440000 None] Lock "cinder-f6741962-3f66-42a1-a2c6-32472f16b378-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:13 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.477s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:13 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Deleted volume successfully.
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-833f1367-77c9-4da2-b06b-a404c50f4e50 tempest-VolumesGetTest-476577892 None] Lock "cinder-c722b99c-1d76-44a0-9a64-4a63b819f621-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:13 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.info" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.337s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:13 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-cb8b6de6-4246-4639-8d1a-69c86456e008 tempest-SnapshotsActionsTest-619975053 None] Create snapshot completed successfully
Apr 10 10:36:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Creating offline snapshot 70133644-0732-4ebb-9b24-8e6e50fab4d9 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:14 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[42685d60-b854-4196-9e51-d9533e0e85d1]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:14 devstack sudo[86733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:14 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:15 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.638s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:15 devstack sudo[86738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 1G
Apr 10 10:36:15 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:15 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 1G" returned: 0 in 0.670s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:15 devstack sudo[86743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9
Apr 10 10:36:15 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:16 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9" returned: 0 in 0.501s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:16 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 is being set with open permissions: ugo+rw
Apr 10 10:36:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:16 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9
Apr 10 10:36:16 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:16 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9" returned: 0 in 0.504s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:16 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-34b5c6be-6cb3-4346-a3c4-4791a64d7bf1 tempest-SnapshotsActionsTest-619975053 None] Create snapshot completed successfully
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Flow 'volume_create_manager' (e285c38f-f9ae-4561-9c16-f6bf19b180bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a0bff7-efbb-4614-9f5b-5f830dcab5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a0bff7-efbb-4614-9f5b-5f830dcab5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-255148850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237c780d-63a8-441f-9a9b-ecc87a204d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124121f99aa441afa64b3af2627fd0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:18Z,use_quota=True,user_id='99edac9fa54c48f4be01f545123efda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d2afc5-bc61-4b98-8d91-421e5547505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d2afc5-bc61-4b98-8d91-421e5547505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522409d4-6232-466e-9bc6-6d824647a88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522409d4-6232-466e-9bc6-6d824647a88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237c780d-63a8-441f-9a9b-ecc87a204d37', 'volume_name': 'volume-237c780d-63a8-441f-9a9b-ecc87a204d37', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f0077-3929-437d-9bdb-509aba7cf04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f0077-3929-437d-9bdb-509aba7cf04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1d1cff-0dd5-4fcd-8924-cd11a1c63b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Volume 237c780d-63a8-441f-9a9b-ecc87a204d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237c780d-63a8-441f-9a9b-ecc87a204d37', 'volume_size': 1}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-255148850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237c780d-63a8-441f-9a9b-ecc87a204d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124121f99aa441afa64b3af2627fd0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:18Z,use_quota=True,user_id='99edac9fa54c48f4be01f545123efda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Creating volume 237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:17 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:17 devstack sudo[86751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 1073741824
Apr 10 10:36:17 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-70133644-0732-4ebb-9b24-8e6e50fab4d9-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-70133644-0732-4ebb-9b24-8e6e50fab4d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-70133644-0732-4ebb-9b24-8e6e50fab4d9" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-70133644-0732-4ebb-9b24-8e6e50fab4d9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Deleting offline snapshot 70133644-0732-4ebb-9b24-8e6e50fab4d9 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] snapshot_file for this snap is: volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[9528e2ee-9b34-463f-bfa8-bf71d4d338ec]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:18 devstack sudo[86753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9
Apr 10 10:36:18 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:18 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 1073741824" returned: 0 in 0.655s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:18 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37
Apr 10 10:36:18 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:18 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9" returned: 0 in 0.668s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:18 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab450a58-6d46-4940-939b-3319307891b1]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:18 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:18 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:19 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37" returned: 0 in 0.567s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1d1cff-0dd5-4fcd-8924-cd11a1c63b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237c780d-63a8-441f-9a9b-ecc87a204d37', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf8164d-a012-46c7-82cb-efabdfeeac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:19 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Volume volume-237c780d-63a8-441f-9a9b-ecc87a204d37 (237c780d-63a8-441f-9a9b-ecc87a204d37): created successfully
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf8164d-a012-46c7-82cb-efabdfeeac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Flow 'volume_create_manager' (e285c38f-f9ae-4561-9c16-f6bf19b180bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-29ebddc0-4b26-465b-9520-f543087ee480 tempest-VolumesCloneTest-899690323 None] Created volume successfully.
Apr 10 10:36:19 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.642s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:19 devstack sudo[86769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9
Apr 10 10:36:19 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:19 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9" returned: 0 in 0.652s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:19 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9
Apr 10 10:36:19 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Flow 'volume_create_manager' (cfd61d68-f487-4a03-b51c-49445d17daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6206389-1027-46e0-b153-412c4cf00366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6206389-1027-46e0-b153-412c4cf00366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1251085173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c460ad-e332-45b6-9064-8236481e8047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124121f99aa441afa64b3af2627fd0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=237c780d-63a8-441f-9a9b-ecc87a204d37,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:20Z,use_quota=True,user_id='99edac9fa54c48f4be01f545123efda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98464731-24bf-4f0a-b166-d72fdcfd6ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98464731-24bf-4f0a-b166-d72fdcfd6ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f703e770-e7ad-408b-a87b-97615d649d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f703e770-e7ad-408b-a87b-97615d649d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e1c460ad-e332-45b6-9064-8236481e8047', 'volume_name': 'volume-e1c460ad-e332-45b6-9064-8236481e8047', 'volume_size': 2, 'source_volid': '237c780d-63a8-441f-9a9b-ecc87a204d37', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce08ba67-22f6-42ad-942d-3fd976b042b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce08ba67-22f6-42ad-942d-3fd976b042b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e98431-dc5a-445b-81fb-0145a94b9492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:20 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Volume e1c460ad-e332-45b6-9064-8236481e8047: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e1c460ad-e332-45b6-9064-8236481e8047', 'volume_size': 2, 'source_volid': '237c780d-63a8-441f-9a9b-ecc87a204d37', 'source_volstatus': 'available'}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:20 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Cloning volume 237c780d-63a8-441f-9a9b-ecc87a204d37 to volume e1c460ad-e332-45b6-9064-8236481e8047
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Creating offline snapshot ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 of volume 237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[12569491-792c-48b3-b8d1-2d12291c5935]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:20 devstack sudo[86777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37
Apr 10 10:36:20 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:20 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.70133644-0732-4ebb-9b24-8e6e50fab4d9" returned: 0 in 0.499s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-70133644-0732-4ebb-9b24-8e6e50fab4d9" released by "_delete_snapshot" :: held 2.526s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" released by "delete_snapshot" :: held 2.542s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Created reservations ['0268396b-5bf3-468a-8bcd-0628543ccf17', 'bf79149f-cbd1-4887-8c77-696e5879cafc', '898f4c7d-8c1d-493a-80c2-be6cc60a4f87', '889867b3-bad2-4f81-9012-445b2b6505a4'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:20 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Delete snapshot completed successfully.
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-75d61c89-018c-458b-b4c2-e986119959ad tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-70133644-0732-4ebb-9b24-8e6e50fab4d9-delete_snapshot" released by "delete_snapshot" :: held 2.701s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:20 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37" returned: 0 in 0.590s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:20 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 1G
Apr 10 10:36:20 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:21 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 1G" returned: 0 in 0.595s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-237c780d-63a8-441f-9a9b-ecc87a204d37 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:21 devstack sudo[86788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-237c780d-63a8-441f-9a9b-ecc87a204d37 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5
Apr 10 10:36:21 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:22 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-237c780d-63a8-441f-9a9b-ecc87a204d37 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" returned: 0 in 0.571s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:22 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 is being set with open permissions: ugo+rw
Apr 10 10:36:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:22 devstack sudo[86793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5
Apr 10 10:36:22 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:22 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" returned: 0 in 0.495s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:22 devstack sudo[86796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.info
Apr 10 10:36:22 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:23 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.info" returned: 0 in 0.605s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:23 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.info is being set with open permissions: ugo+rw
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:23 devstack sudo[86799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.info
Apr 10 10:36:23 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:23 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.info" returned: 0 in 0.632s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Acquiring lock "cinder-quobyte-e1c460ad-e332-45b6-9064-8236481e8047" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-e1c460ad-e332-45b6-9064-8236481e8047" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] snapshot: ac05a9db-9cc9-482b-8d7f-70cb253cf3e5, volume: e1c460ad-e332-45b6-9064-8236481e8047,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ea4573-d5db-454c-84d4-6f67a9c4efea]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:23 devstack sudo[86802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5
Apr 10 10:36:23 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:24 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" returned: 0 in 0.665s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-237c780d-63a8-441f-9a9b-ecc87a204d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22b6b70-98dc-4dfa-b7e7-211c572c55de]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (b48c3dfd-4dbd-4f11-8c19-0487599615a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c94d0e0-6b0c-4196-8363-f89b9e7742bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c94d0e0-6b0c-4196-8363-f89b9e7742bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1950948828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d5672c-a669-4377-a904-8fd06f9e215e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:24Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcca1be-023a-4aad-8e2f-5b674bca04c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcca1be-023a-4aad-8e2f-5b674bca04c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3920ff1e-acac-4735-abfa-381111a0248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3920ff1e-acac-4735-abfa-381111a0248d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d5672c-a669-4377-a904-8fd06f9e215e', 'volume_name': 'volume-f7d5672c-a669-4377-a904-8fd06f9e215e', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b81cf6-c02e-4228-8fcc-a63dc6a0f417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b81cf6-c02e-4228-8fcc-a63dc6a0f417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bf1d32-9427-4f8b-a37c-7a4e29727d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:24 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume f7d5672c-a669-4377-a904-8fd06f9e215e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d5672c-a669-4377-a904-8fd06f9e215e', 'volume_size': 1}
Apr 10 10:36:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:24 devstack sudo[86807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37
Apr 10 10:36:24 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:25 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37" returned: 0 in 0.613s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:25 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:36:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:25 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047
Apr 10 10:36:25 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:27 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047" returned: 0 in 2.682s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:27 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8e8da1-1356-46f9-a459-2f8362269037]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:27 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37
Apr 10 10:36:27 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:28 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37" returned: 0 in 0.641s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:36:28 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Converted 1024.00 MB image at 381.53 MB/s
Apr 10 10:36:28 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047 is being set with open permissions: ugo+rw
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:28 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047
Apr 10 10:36:28 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:28 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047" returned: 0 in 0.459s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-e1c460ad-e332-45b6-9064-8236481e8047" released by "_copy_volume_from_snapshot" :: held 5.152s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Acquiring lock "cinder-quobyte-ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Deleting offline snapshot ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 of volume 237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] snapshot_file for this snap is: volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4819d55-7035-4e9d-b4a2-246f4dc364f4]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:29 devstack sudo[86834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5
Apr 10 10:36:29 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:29 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" returned: 0 in 0.518s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-237c780d-63a8-441f-9a9b-ecc87a204d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:29 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[110ea233-e890-49b1-bfac-9152c910d194]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:29 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37
Apr 10 10:36:29 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:30 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37" returned: 0 in 0.514s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:30 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5
Apr 10 10:36:30 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:30 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" returned: 0 in 0.454s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:30 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5
Apr 10 10:36:30 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:30 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37.ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" returned: 0 in 0.446s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-ac05a9db-9cc9-482b-8d7f-70cb253cf3e5" released by "_delete_snapshot" :: held 1.979s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.753s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.759s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:30 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Creating offline snapshot 4f3bac43-3d23-4c02-8f93-9a0ead2befe4 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e98431-dc5a-445b-81fb-0145a94b9492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c460ad-e332-45b6-9064-8236481e8047', 'volume_size': 2, 'source_volid': '237c780d-63a8-441f-9a9b-ecc87a204d37', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f20558d-4884-4aba-81ca-e9f374d86c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fa6706-963c-46ad-bcf4-2bdb6e1b688f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:31 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Volume volume-e1c460ad-e332-45b6-9064-8236481e8047 (e1c460ad-e332-45b6-9064-8236481e8047): created successfully
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f20558d-4884-4aba-81ca-e9f374d86c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Flow 'volume_create_manager' (cfd61d68-f487-4a03-b51c-49445d17daa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-8249d3c7-7dd5-4ba4-bbab-def141708dd3 tempest-VolumesCloneTest-899690323 None] Created volume successfully.
Apr 10 10:36:31 devstack sudo[86853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:31 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:31 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.485s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:31 devstack sudo[86858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 1G
Apr 10 10:36:31 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:32 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 1G" returned: 0 in 0.551s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:32 devstack sudo[86863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4
Apr 10 10:36:32 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Acquiring lock "cinder-e1c460ad-e332-45b6-9064-8236481e8047-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Lock "cinder-e1c460ad-e332-45b6-9064-8236481e8047-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Acquiring lock "cinder-quobyte-e1c460ad-e332-45b6-9064-8236481e8047" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-e1c460ad-e332-45b6-9064-8236481e8047" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1369d5-a90d-456c-bb43-a6fd2d6037cc]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:32 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047
Apr 10 10:36:32 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:32 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4" returned: 0 in 0.517s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:32 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 is being set with open permissions: ugo+rw
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:32 devstack sudo[86870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4
Apr 10 10:36:32 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:32 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:32 devstack sudo[86875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047
Apr 10 10:36:32 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:33 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4" returned: 0 in 0.469s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.478s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1950948828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d5672c-a669-4377-a904-8fd06f9e215e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:24Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Creating volume f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:33 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:33 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e 1073741824
Apr 10 10:36:33 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:33 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c0e663b0-001f-4d5e-8915-6fc2116c7c1a tempest-SnapshotsActionsTest-619975053 None] Create snapshot completed successfully
Apr 10 10:36:33 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1c460ad-e332-45b6-9064-8236481e8047" returned: 0 in 0.460s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-e1c460ad-e332-45b6-9064-8236481e8047" released by "delete_volume" :: held 1.048s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Created reservations ['d7d2da60-cd43-4fee-bf25-0ee1ca28c339', '6c46d334-ea04-4683-b28b-bbd921dada52', '58e908bd-f00f-4200-bcac-f79bbcdd2347', '52c8e4f6-8e6f-4ace-b158-8b808a4673bf'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:33 devstack sudo[86881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:33 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:33 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e 1073741824" returned: 0 in 0.597s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:33 devstack sudo[86886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e
Apr 10 10:36:33 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-4f3bac43-3d23-4c02-8f93-9a0ead2befe4-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-4f3bac43-3d23-4c02-8f93-9a0ead2befe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:33 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-4f3bac43-3d23-4c02-8f93-9a0ead2befe4" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.531s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:33 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Deleted volume successfully.
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-4f3bac43-3d23-4c02-8f93-9a0ead2befe4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Deleting offline snapshot 4f3bac43-3d23-4c02-8f93-9a0ead2befe4 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] snapshot_file for this snap is: volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e90548b2-7b60-4388-ad76-feaa25f1394e tempest-VolumesCloneTest-899690323 None] Lock "cinder-e1c460ad-e332-45b6-9064-8236481e8047-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a95e74d-dba2-4340-b4dc-cdf9fa05c1dc]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:34 devstack sudo[86889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4
Apr 10 10:36:34 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:34 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e" returned: 0 in 0.472s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bf1d32-9427-4f8b-a37c-7a4e29727d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d5672c-a669-4377-a904-8fd06f9e215e', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a881c673-0798-4c69-874e-769cf1d166ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume volume-f7d5672c-a669-4377-a904-8fd06f9e215e (f7d5672c-a669-4377-a904-8fd06f9e215e): created successfully
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a881c673-0798-4c69-874e-769cf1d166ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (b48c3dfd-4dbd-4f11-8c19-0487599615a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:34 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-2795cf8a-0bb2-4a74-bead-fd5c549e0c16 tempest-VolumesSnapshotTestJSON-1045750709 None] Created volume successfully.
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Acquiring lock "cinder-237c780d-63a8-441f-9a9b-ecc87a204d37-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Lock "cinder-237c780d-63a8-441f-9a9b-ecc87a204d37-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Acquiring lock "cinder-quobyte-237c780d-63a8-441f-9a9b-ecc87a204d37" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-237c780d-63a8-441f-9a9b-ecc87a204d37" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5102a5-f9e7-4b41-9820-3c8c4ea35016]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:34 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4" returned: 0 in 0.579s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0806e04-4186-40db-8f6b-4141af9b1cba]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:34 devstack sudo[86895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37
Apr 10 10:36:34 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:34 devstack sudo[86896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:34 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:34 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37" returned: 0 in 0.493s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:35 devstack sudo[86905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37
Apr 10 10:36:35 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:35 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.504s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:35 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4
Apr 10 10:36:35 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Creating offline snapshot fa6caf7f-a94f-4499-8a82-a4e440ee3f88 of volume f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07324dd-de57-4372-9527-cfb78a0684a3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:35 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-237c780d-63a8-441f-9a9b-ecc87a204d37" returned: 0 in 0.553s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:35 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e
Apr 10 10:36:35 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Lock "cinder-quobyte-237c780d-63a8-441f-9a9b-ecc87a204d37" released by "delete_volume" :: held 1.104s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Created reservations ['2a3ea76a-dc37-4028-af56-81598150e131', '1ca2b3bc-64b4-46ba-ba0a-fb647c2ed0ab', '2d17dcee-5bef-4ec7-b4a5-c1464bd1f1b7', 'edfb195c-9a90-4257-878f-1efffb4cdd55'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:35 devstack sudo[86915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:35 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:35 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4" returned: 0 in 0.672s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:35 devstack sudo[86917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4
Apr 10 10:36:35 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:35 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e" returned: 0 in 0.523s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:36 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 1G
Apr 10 10:36:36 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:36 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.478s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Deleted volume successfully.
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-407b7772-432c-4afa-b52f-fc8f3ae05d87 tempest-VolumesCloneTest-899690323 None] Lock "cinder-237c780d-63a8-441f-9a9b-ecc87a204d37-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:36 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.4f3bac43-3d23-4c02-8f93-9a0ead2befe4" returned: 0 in 0.485s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-4f3bac43-3d23-4c02-8f93-9a0ead2befe4" released by "_delete_snapshot" :: held 2.318s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" released by "delete_snapshot" :: held 2.345s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Created reservations ['e1030833-77e8-480b-98a3-d0dedb51514f', '0cb0e4af-825e-4a85-8737-a889aba79fb1', '372d1bf5-8df8-4a34-a113-482c698d7ed8', '668039aa-7c22-4700-aa04-727dcc21ab09'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Delete snapshot completed successfully.
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-98bced4b-3678-4e99-a19a-4e7e209f960d tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-4f3bac43-3d23-4c02-8f93-9a0ead2befe4-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:36 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 1G" returned: 0 in 0.594s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d5672c-a669-4377-a904-8fd06f9e215e -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:36 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d5672c-a669-4377-a904-8fd06f9e215e -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88
Apr 10 10:36:36 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:37 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d5672c-a669-4377-a904-8fd06f9e215e -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88" returned: 0 in 0.553s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:37 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 is being set with open permissions: ugo+rw
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:37 devstack sudo[86934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88
Apr 10 10:36:37 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:37 devstack sudo[86936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:37 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:37 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88" returned: 0 in 0.541s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:37 devstack sudo[86939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.info
Apr 10 10:36:37 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:37 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.547s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:37 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:38 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.info" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:38 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.info is being set with open permissions: ugo+rw
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:38 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.info
Apr 10 10:36:38 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:38 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Flow 'volume_create_manager' (1f66faa2-22da-4b48-80f6-81ad3eaf55fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9dc298-dc56-46ca-9671-621b699630a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.info" returned: 0 in 0.582s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.425s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9dc298-dc56-46ca-9671-621b699630a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-230608230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c106e4-9c77-402b-a95c-410aaf8aa4b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57f155c7354743079ed392706e12ad5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='0c0eaf4d6781439b99afedeb81cbd068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca158a-23e1-4e3b-a600-f216c3141834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca158a-23e1-4e3b-a600-f216c3141834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2751c21f-b797-4365-b59f-4648beab8886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2751c21f-b797-4365-b59f-4648beab8886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c106e4-9c77-402b-a95c-410aaf8aa4b4', 'volume_name': 'volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6213e97-9796-4e6f-9a9e-5a74f46d26cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6213e97-9796-4e6f-9a9e-5a74f46d26cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c3e107-b18d-486e-9c80-b9c1902fe864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:38 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Volume d9c106e4-9c77-402b-a95c-410aaf8aa4b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4', 'volume_size': 1}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-230608230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c106e4-9c77-402b-a95c-410aaf8aa4b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57f155c7354743079ed392706e12ad5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='0c0eaf4d6781439b99afedeb81cbd068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Creating volume d9c106e4-9c77-402b-a95c-410aaf8aa4b4 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:38 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:38 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4 1073741824
Apr 10 10:36:38 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:38 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-93396b87-1b69-4be8-8ccc-42142c098fc3 tempest-VolumesSnapshotTestJSON-1045750709 None] Create snapshot completed successfully
Apr 10 10:36:39 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4 1073741824" returned: 0 in 0.581s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:39 devstack sudo[86952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4
Apr 10 10:36:39 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-fa6caf7f-a94f-4499-8a82-a4e440ee3f88-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-fa6caf7f-a94f-4499-8a82-a4e440ee3f88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-f7d5672c-a669-4377-a904-8fd06f9e215e" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-f7d5672c-a669-4377-a904-8fd06f9e215e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-fa6caf7f-a94f-4499-8a82-a4e440ee3f88" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-fa6caf7f-a94f-4499-8a82-a4e440ee3f88" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Deleting offline snapshot fa6caf7f-a94f-4499-8a82-a4e440ee3f88 of volume f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] snapshot_file for this snap is: volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a34fe8-3094-4aa3-a9d4-b79d80b94387]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:39 devstack sudo[86954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88
Apr 10 10:36:39 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:40 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4" returned: 0 in 0.506s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.643s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c3e107-b18d-486e-9c80-b9c1902fe864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511b07cd-7f1e-466f-b77a-558945b84a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Creating offline snapshot bf4d590e-d46d-4854-9315-ad466b457c10 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d3c3a2-9479-4cbb-9699-8e9c579cf160]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:40 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Volume volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4 (d9c106e4-9c77-402b-a95c-410aaf8aa4b4): created successfully
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511b07cd-7f1e-466f-b77a-558945b84a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Flow 'volume_create_manager' (1f66faa2-22da-4b48-80f6-81ad3eaf55fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:40 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1cf86c2d-839a-42ba-ac40-54ad501ce3fa tempest-VolumesListTestJSON-48056924 None] Created volume successfully.
Apr 10 10:36:40 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:40 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:40 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88" returned: 0 in 0.544s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7d5672c-a669-4377-a904-8fd06f9e215e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef360aa-c9c4-4d76-815d-31b461cfa0d6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:40 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e
Apr 10 10:36:40 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:40 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.538s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:40 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 1G
Apr 10 10:36:40 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:40 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e" returned: 0 in 0.501s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:40 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88
Apr 10 10:36:40 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:41 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 1G" returned: 0 in 0.572s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:41 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10
Apr 10 10:36:41 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Flow 'volume_create_manager' (6d16aa5b-4cc3-4f23-89e2-e5b3b620a511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de6d5b4-7e8c-4da4-9b06-ba425f9cd30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de6d5b4-7e8c-4da4-9b06-ba425f9cd30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420677116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57f155c7354743079ed392706e12ad5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:41Z,use_quota=True,user_id='0c0eaf4d6781439b99afedeb81cbd068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b383f39-88d8-4ece-ace5-99c4dd7a7d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b383f39-88d8-4ece-ace5-99c4dd7a7d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ca4b03-ebf7-4d14-aef0-7e623e93ffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ca4b03-ebf7-4d14-aef0-7e623e93ffe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32', 'volume_name': 'volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350ec570-921a-40ad-8159-a6b7a22494fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350ec570-921a-40ad-8159-a6b7a22494fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5a4fa7-906c-4b22-963b-54596d9c84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:41 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Volume e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32', 'volume_size': 1}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:41 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88" returned: 0 in 0.529s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:41 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88
Apr 10 10:36:41 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:41 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10" returned: 0 in 0.489s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:41 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 is being set with open permissions: ugo+rw
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:41 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10
Apr 10 10:36:41 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:41 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e.fa6caf7f-a94f-4499-8a82-a4e440ee3f88" returned: 0 in 0.448s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-fa6caf7f-a94f-4499-8a82-a4e440ee3f88" released by "_delete_snapshot" :: held 2.084s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-f7d5672c-a669-4377-a904-8fd06f9e215e" released by "delete_snapshot" :: held 2.097s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['9425418a-8dcd-41b7-9e20-f41aa6d51e90', '8cdf3a33-4f1e-4ed0-a8a7-139600a93f7b', 'dbfa7437-64df-44d9-aa21-e5d23af69dc9', 'cc864196-ad65-43f2-a129-2ba38287afdb'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:41 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Delete snapshot completed successfully.
Apr 10 10:36:41 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3e33727f-487d-4ca4-9e74-8200620a7c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-fa6caf7f-a94f-4499-8a82-a4e440ee3f88-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:42 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10" returned: 0 in 0.447s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.852s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420677116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57f155c7354743079ed392706e12ad5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:41Z,use_quota=True,user_id='0c0eaf4d6781439b99afedeb81cbd068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Creating volume e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:42 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:42 devstack sudo[86991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 1073741824
Apr 10 10:36:42 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c1eeeef1-e43f-4ff9-a6f8-09f4cd797d65 tempest-SnapshotsActionsTest-619975053 None] Create snapshot completed successfully
Apr 10 10:36:42 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-bf4d590e-d46d-4854-9315-ad466b457c10-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-bf4d590e-d46d-4854-9315-ad466b457c10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-bf4d590e-d46d-4854-9315-ad466b457c10" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-bf4d590e-d46d-4854-9315-ad466b457c10" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Deleting offline snapshot bf4d590e-d46d-4854-9315-ad466b457c10 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] snapshot_file for this snap is: volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3888c1-c396-4aac-8a2c-abad655f2052]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:42 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 1073741824" returned: 0 in 0.573s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:42 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32
Apr 10 10:36:42 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:42 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10
Apr 10 10:36:42 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:43 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32" returned: 0 in 0.448s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5a4fa7-906c-4b22-963b-54596d9c84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5ec921-97a7-47f2-af24-26042c6e49ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Volume volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 (e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32): created successfully
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5ec921-97a7-47f2-af24-26042c6e49ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Flow 'volume_create_manager' (6d16aa5b-4cc3-4f23-89e2-e5b3b620a511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:43 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f5197a9a-6d24-4d48-b5d6-45e14e7a6655 tempest-VolumesListTestJSON-48056924 None] Created volume successfully.
Apr 10 10:36:43 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10" returned: 0 in 0.561s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (d1a51b31-bc99-44ee-98e6-4a8ebd4221b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1f510-04a9-4759-946f-66a785223c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d592a10f-15b6-4a09-b300-f92281dabd6f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1f510-04a9-4759-946f-66a785223c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1410402012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68731cbc-686b-4a1a-a031-462b88a5778f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:43Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6e5c42-f021-4f24-8291-5bdc87623eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6e5c42-f021-4f24-8291-5bdc87623eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875e1e59-b8ca-4653-81ff-8fe0d02bdcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875e1e59-b8ca-4653-81ff-8fe0d02bdcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68731cbc-686b-4a1a-a031-462b88a5778f', 'volume_name': 'volume-68731cbc-686b-4a1a-a031-462b88a5778f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11796359-3ee7-42a4-bedd-63d5b733110f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11796359-3ee7-42a4-bedd-63d5b733110f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f27d359-7f1e-44ae-a5e1-b8e79da8a4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Volume 68731cbc-686b-4a1a-a031-462b88a5778f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68731cbc-686b-4a1a-a031-462b88a5778f', 'volume_size': 1}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1410402012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68731cbc-686b-4a1a-a031-462b88a5778f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:43Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Creating volume 68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:43 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:43 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f 1073741824
Apr 10 10:36:43 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:43 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:43 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Flow 'volume_create_manager' (d90a75e2-bcf0-4d6e-bc68-d0a0a8bcd27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccc1ae1-63ce-4c32-ab4e-8014f57b6d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccc1ae1-63ce-4c32-ab4e-8014f57b6d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1977535729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13d4b10-6441-416d-b62d-73f8deb3bcfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57f155c7354743079ed392706e12ad5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:44Z,use_quota=True,user_id='0c0eaf4d6781439b99afedeb81cbd068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b5733-7d3e-4ffe-819d-5823ab4c1a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b5733-7d3e-4ffe-819d-5823ab4c1a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cad4e7c-aef9-451f-beef-bd156de1ea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cad4e7c-aef9-451f-beef-bd156de1ea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13d4b10-6441-416d-b62d-73f8deb3bcfc', 'volume_name': 'volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a7d03b-5aca-48f6-a408-f1792fbb7377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a7d03b-5aca-48f6-a408-f1792fbb7377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6026a37-ed0d-4614-bcc1-a1d5e290cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:43 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Volume e13d4b10-6441-416d-b62d-73f8deb3bcfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc', 'volume_size': 1}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:43 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f 1073741824" returned: 0 in 0.511s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:43 devstack sudo[87014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f
Apr 10 10:36:43 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:43 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.599s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:43 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10
Apr 10 10:36:43 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:44 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f" returned: 0 in 0.414s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1977535729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13d4b10-6441-416d-b62d-73f8deb3bcfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57f155c7354743079ed392706e12ad5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:44Z,use_quota=True,user_id='0c0eaf4d6781439b99afedeb81cbd068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Creating volume e13d4b10-6441-416d-b62d-73f8deb3bcfc {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:44 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f27d359-7f1e-44ae-a5e1-b8e79da8a4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68731cbc-686b-4a1a-a031-462b88a5778f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a12dd4-d5d3-4b67-bcbb-5690bedc2acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:44 devstack sudo[87021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc 1073741824
Apr 10 10:36:44 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:44 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Volume volume-68731cbc-686b-4a1a-a031-462b88a5778f (68731cbc-686b-4a1a-a031-462b88a5778f): created successfully
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a12dd4-d5d3-4b67-bcbb-5690bedc2acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (d1a51b31-bc99-44ee-98e6-4a8ebd4221b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:44 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ff7928c8-02b3-4927-805b-1d39a631f08c tempest-VolumesSnapshotTestJSON-1045750709 None] Created volume successfully.
Apr 10 10:36:44 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10" returned: 0 in 0.516s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:44 devstack sudo[87024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10
Apr 10 10:36:44 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:44 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc 1073741824" returned: 0 in 0.579s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:44 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc
Apr 10 10:36:44 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:44 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.bf4d590e-d46d-4854-9315-ad466b457c10" returned: 0 in 0.488s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-bf4d590e-d46d-4854-9315-ad466b457c10" released by "_delete_snapshot" :: held 2.305s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" released by "delete_snapshot" :: held 2.318s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Created reservations ['2c4698d8-0d2f-4812-a3a6-49b5559a9f17', '7ca18ef8-fc34-499c-891a-3e148545d887', '2c7b6634-daba-488d-b7f9-e327f4052390', 'adc81457-5577-4b3d-8e2a-19941b87f1f5'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:45 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Delete snapshot completed successfully.
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bebe7e3-fe65-4025-9b97-adf94c3a2f70 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-bf4d590e-d46d-4854-9315-ad466b457c10-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:45 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc" returned: 0 in 0.474s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6026a37-ed0d-4614-bcc1-a1d5e290cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959e668b-57d3-4468-8189-c006b3757bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:45 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Volume volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc (e13d4b10-6441-416d-b62d-73f8deb3bcfc): created successfully
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959e668b-57d3-4468-8189-c006b3757bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Flow 'volume_create_manager' (d90a75e2-bcf0-4d6e-bc68-d0a0a8bcd27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:45 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9488260e-6a47-4e04-8903-2f7116689014 tempest-VolumesListTestJSON-48056924 None] Created volume successfully.
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Creating offline snapshot 0ef672e4-30e3-4188-9ade-d00b686f3feb of volume 68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[41365cb8-e4f6-4f0c-b435-29ca0b446c2d]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:45 devstack sudo[87033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f
Apr 10 10:36:45 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:46 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f" returned: 0 in 0.649s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:46 devstack sudo[87039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb 1G
Apr 10 10:36:46 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:46 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb 1G" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68731cbc-686b-4a1a-a031-462b88a5778f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:46 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68731cbc-686b-4a1a-a031-462b88a5778f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb
Apr 10 10:36:46 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:47 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68731cbc-686b-4a1a-a031-462b88a5778f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb" returned: 0 in 0.601s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:47 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb is being set with open permissions: ugo+rw
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:47 devstack sudo[87049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb
Apr 10 10:36:47 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:47 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb" returned: 0 in 0.494s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Acquiring lock "cinder-e13d4b10-6441-416d-b62d-73f8deb3bcfc-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:47 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.info
Apr 10 10:36:47 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Lock "cinder-e13d4b10-6441-416d-b62d-73f8deb3bcfc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Acquiring lock "cinder-quobyte-e13d4b10-6441-416d-b62d-73f8deb3bcfc" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Lock "cinder-quobyte-e13d4b10-6441-416d-b62d-73f8deb3bcfc" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c12f65-e988-4502-9526-bee8569d37a4]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:48 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc
Apr 10 10:36:48 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:48 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.info" returned: 0 in 0.466s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:48 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.info is being set with open permissions: ugo+rw
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:48 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.info
Apr 10 10:36:48 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:48 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc" returned: 0 in 0.540s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:48 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc
Apr 10 10:36:48 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:48 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.info" returned: 0 in 0.443s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.749s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Creating offline snapshot 33db2340-9a29-4afe-8b55-f54de9cacf90 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:36:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-86d14dfd-fd3e-4c01-bd37-8568fcef850b tempest-VolumesSnapshotTestJSON-1045750709 None] Create snapshot completed successfully
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c60b12e-6929-41c1-a232-2881c36438c6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:48 devstack sudo[87067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:48 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:49 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e13d4b10-6441-416d-b62d-73f8deb3bcfc" returned: 0 in 0.526s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Lock "cinder-quobyte-e13d4b10-6441-416d-b62d-73f8deb3bcfc" released by "delete_volume" :: held 1.091s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Created reservations ['230231b1-8798-4b72-b892-e499c1ad2236', '77130b34-9666-4112-b5b8-2c56697d31a1', 'b646c14d-2b20-4cd8-be36-9ddd60796f5b', '63e0ddbc-ed87-4471-9527-dc1cc52b6ef1'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:49 devstack sudo[87074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:49 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:49 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.561s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:49 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 1G
Apr 10 10:36:49 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:49 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.536s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:49 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Deleted volume successfully.
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5b9d3213-6022-4d94-9084-dfbedad36cec tempest-VolumesListTestJSON-48056924 None] Lock "cinder-e13d4b10-6441-416d-b62d-73f8deb3bcfc-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:49 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:50 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (e69f9b85-df72-4088-8cc3-dec43b5bdfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aa5da5-bbe6-43ac-9c9c-b60851a5aa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aa5da5-bbe6-43ac-9c9c-b60851a5aa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1002693793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260a5685-3250-4c26-ad30-8724ff7004a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0ef672e4-30e3-4188-9ade-d00b686f3feb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:50Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f502f0f4-8d9f-43f8-8a12-0f28ba68d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f502f0f4-8d9f-43f8-8a12-0f28ba68d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df79cb6-badc-411d-a1dd-cc4813dd8af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df79cb6-badc-411d-a1dd-cc4813dd8af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '260a5685-3250-4c26-ad30-8724ff7004a9', 'volume_name': 'volume-260a5685-3250-4c26-ad30-8724ff7004a9', 'volume_size': 2, 'snapshot_id': '0ef672e4-30e3-4188-9ade-d00b686f3feb'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640c137f-b516-41fe-8c64-20b0374243a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640c137f-b516-41fe-8c64-20b0374243a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd0bee-d453-4342-a7d3-218dd36eeab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:50 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume 260a5685-3250-4c26-ad30-8724ff7004a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-260a5685-3250-4c26-ad30-8724ff7004a9', 'volume_size': 2, 'snapshot_id': '0ef672e4-30e3-4188-9ade-d00b686f3feb'}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 1G" returned: 0 in 0.661s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:50 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90
Apr 10 10:36:50 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "cinder-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "cinder-quobyte-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-quobyte-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f210d5b3-1132-460e-b809-4471e8eea30a]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:50 devstack sudo[87088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32
Apr 10 10:36:50 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:50 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90" returned: 0 in 0.509s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:50 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 is being set with open permissions: ugo+rw
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:50 devstack sudo[87093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90
Apr 10 10:36:50 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:50 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32" returned: 0 in 0.568s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:50 devstack sudo[87098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32
Apr 10 10:36:50 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:51 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90" returned: 0 in 0.470s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.985s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-0ef672e4-30e3-4188-9ade-d00b686f3feb-260a5685-3250-4c26-ad30-8724ff7004a9" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0ef672e4-30e3-4188-9ade-d00b686f3feb-260a5685-3250-4c26-ad30-8724ff7004a9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Creating volume 260a5685-3250-4c26-ad30-8724ff7004a9 from snapshot 0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-260a5685-3250-4c26-ad30-8724ff7004a9" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:51 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e9f84716-0ddd-4741-a2c8-752dd33dbaec tempest-SnapshotsActionsTest-619975053 None] Create snapshot completed successfully
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-260a5685-3250-4c26-ad30-8724ff7004a9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] snapshot: 0ef672e4-30e3-4188-9ade-d00b686f3feb, volume: 260a5685-3250-4c26-ad30-8724ff7004a9,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[871ff03d-e372-4684-9e3b-e2495e73417f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:51 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb
Apr 10 10:36:51 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-33db2340-9a29-4afe-8b55-f54de9cacf90-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:51 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32" returned: 0 in 0.549s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-quobyte-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32" released by "delete_volume" :: held 1.157s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-33db2340-9a29-4afe-8b55-f54de9cacf90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Acquiring lock "cinder-quobyte-33db2340-9a29-4afe-8b55-f54de9cacf90" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-33db2340-9a29-4afe-8b55-f54de9cacf90" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Deleting offline snapshot 33db2340-9a29-4afe-8b55-f54de9cacf90 of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] snapshot_file for this snap is: volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbb08c7-f77a-46a5-beb9-b1b0375f8dd6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Created reservations ['ab2d7806-da67-460f-ab6c-b35468534d4f', 'c01523ce-fbf4-4f7d-823d-0f41829d709a', '6f0698ad-6906-416d-9b5d-98325499aae4', '8750414b-1154-4a56-bef7-f5c0f12da649'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:51 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90
Apr 10 10:36:51 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:51 devstack sudo[87106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:51 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:51 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb" returned: 0 in 0.622s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68731cbc-686b-4a1a-a031-462b88a5778f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e35f78-f1a1-40c1-8759-0dd31fe292af]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:51 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f
Apr 10 10:36:51 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:51 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90" returned: 0 in 0.541s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e5e6d-ad94-415b-9bf1-b1aae4b0ba37]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:52 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.508s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Deleted volume successfully.
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-faf82235-f3f1-4a8d-a60f-a8b091a8ea34 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-e3328ac4-b8bb-4c7d-ba98-c72b5ad35a32-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:52 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:52 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:52 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:52 devstack sudo[87122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9
Apr 10 10:36:52 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "cinder-d9c106e4-9c77-402b-a95c-410aaf8aa4b4-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-d9c106e4-9c77-402b-a95c-410aaf8aa4b4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "cinder-quobyte-d9c106e4-9c77-402b-a95c-410aaf8aa4b4" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-quobyte-d9c106e4-9c77-402b-a95c-410aaf8aa4b4" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23b2c0e-83a6-4f6c-a7f8-6fb93fe49a84]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:52 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.585s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:52 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90
Apr 10 10:36:52 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:52 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4
Apr 10 10:36:52 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:53 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4" returned: 0 in 0.938s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:53 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4
Apr 10 10:36:53 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:53 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90" returned: 0 in 1.181s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:53 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90
Apr 10 10:36:53 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:54 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9" returned: 0 in 2.388s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa43749-af2b-4676-88db-f077ec513b26]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:54 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f
Apr 10 10:36:54 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:54 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d9c106e4-9c77-402b-a95c-410aaf8aa4b4" returned: 0 in 1.368s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-quobyte-d9c106e4-9c77-402b-a95c-410aaf8aa4b4" released by "delete_volume" :: held 2.328s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=122,cinder:INSERT=39,cinder:UPDATE=163,cinder:DELETE=17 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:UPDATE=137,cinder:SELECT=141,cinder:INSERT=47,cinder:DELETE=12 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Created reservations ['a781556a-e7a0-48c5-88ce-7d7f6b90b2cb', '312eb50f-7092-482c-af0d-ba04cfd3a42c', '66574599-d626-4feb-a481-1bd47fdc470a', 'afa22fd9-be1f-4297-9c04-629f4c51b129'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:54 devstack sudo[87155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:54 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:54 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.33db2340-9a29-4afe-8b55-f54de9cacf90" returned: 0 in 1.211s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-33db2340-9a29-4afe-8b55-f54de9cacf90" released by "_delete_snapshot" :: held 3.580s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" released by "delete_snapshot" :: held 3.604s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Created reservations ['9a6facd9-fb69-4815-8f86-4c5dd7f876bc', '3828b5ef-01cb-4dc1-9dfc-8905a6e37182', '54a2b188-4fc8-4f70-a80c-7dec8f0586af', '67a59412-6166-4197-bb02-8e3191ca12a5'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Delete snapshot completed successfully.
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d4732b58-c858-4636-9981-4853629bd9b7 tempest-SnapshotsActionsTest-2096050661 None] Lock "cinder-33db2340-9a29-4afe-8b55-f54de9cacf90-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:55 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f" returned: 0 in 0.676s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:36:55 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Converted 1024.00 MB image at 428.63 MB/s
Apr 10 10:36:55 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9 is being set with open permissions: ugo+rw
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:55 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9
Apr 10 10:36:55 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:55 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.494s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Deleted volume successfully.
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4030d721-8e62-4f33-97a3-a2f681122276 tempest-VolumesListTestJSON-48056924 None] Lock "cinder-d9c106e4-9c77-402b-a95c-410aaf8aa4b4-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:55 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9" returned: 0 in 0.532s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-260a5685-3250-4c26-ad30-8724ff7004a9" released by "_copy_volume_from_snapshot" :: held 4.823s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0ef672e4-30e3-4188-9ade-d00b686f3feb-260a5685-3250-4c26-ad30-8724ff7004a9" released by "_create_volume_from_snapshot" :: held 4.847s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.868s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd0bee-d453-4342-a7d3-218dd36eeab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260a5685-3250-4c26-ad30-8724ff7004a9', 'volume_size': 2, 'snapshot_id': '0ef672e4-30e3-4188-9ade-d00b686f3feb'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbb9271-2c1b-4269-ac70-3b48838f0141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:55 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume volume-260a5685-3250-4c26-ad30-8724ff7004a9 (260a5685-3250-4c26-ad30-8724ff7004a9): created successfully
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbb9271-2c1b-4269-ac70-3b48838f0141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (e69f9b85-df72-4088-8cc3-dec43b5bdfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-317f5474-e115-4ee7-9ca5-61f24b362f31 tempest-VolumesSnapshotTestJSON-1045750709 None] Created volume successfully.
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "cinder-528577bd-4be7-402c-8c73-d987238c2c6f-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-528577bd-4be7-402c-8c73-d987238c2c6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "cinder-quobyte-528577bd-4be7-402c-8c73-d987238c2c6f" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-quobyte-528577bd-4be7-402c-8c73-d987238c2c6f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Deleting offline snapshot 528577bd-4be7-402c-8c73-d987238c2c6f of volume 87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] snapshot_file for this snap is: volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da865d-f866-44c6-98bd-3bc4050e0f05]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:56 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:56 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-260a5685-3250-4c26-ad30-8724ff7004a9-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-260a5685-3250-4c26-ad30-8724ff7004a9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-260a5685-3250-4c26-ad30-8724ff7004a9" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-260a5685-3250-4c26-ad30-8724ff7004a9" acquired by "delete_volume" :: waited 0.020s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:56 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.675s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87685e04-1db5-4330-a9d6-d19fd518d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1067b5b8-721c-412a-88b6-d3383f222f2f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e430a53-7c6a-4886-aa57-2cc25307216b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:56 devstack sudo[87170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582
Apr 10 10:36:56 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:56 devstack sudo[87169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9
Apr 10 10:36:56 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:57 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582" returned: 0 in 0.743s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:57 devstack sudo[87213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:57 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:57 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9" returned: 0 in 0.887s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:57 devstack sudo[87215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9
Apr 10 10:36:57 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:58 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.761s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:58 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f
Apr 10 10:36:58 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:58 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-260a5685-3250-4c26-ad30-8724ff7004a9" returned: 0 in 0.809s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-260a5685-3250-4c26-ad30-8724ff7004a9" released by "delete_volume" :: held 1.736s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Flow 'volume_create_manager' (4fed89ca-61f8-461e-8c7b-7ffec2c59388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c99fab-abfe-4db8-9dd0-46ba05b35a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c99fab-abfe-4db8-9dd0-46ba05b35a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1159869461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ec34ff-e44f-4a5c-9a8e-21cf1dad609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8a50db3ac94331a76166f4065d2097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:58Z,use_quota=True,user_id='aa9f2d24c6a646d8a60d5864dfc0d2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52bc76b-b6f0-4d2e-999b-ba2791c6a916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52bc76b-b6f0-4d2e-999b-ba2791c6a916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f026628b-25a0-4656-845b-2ad37948c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f026628b-25a0-4656-845b-2ad37948c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ec34ff-e44f-4a5c-9a8e-21cf1dad609c', 'volume_name': 'volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d693e-66fe-4d76-90cf-bf09030c8318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d693e-66fe-4d76-90cf-bf09030c8318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3453d9-b9d9-44d8-9671-c3292548ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:36:58 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Volume 10ec34ff-e44f-4a5c-9a8e-21cf1dad609c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c', 'volume_size': 1}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1159869461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ec34ff-e44f-4a5c-9a8e-21cf1dad609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8a50db3ac94331a76166f4065d2097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:58Z,use_quota=True,user_id='aa9f2d24c6a646d8a60d5864dfc0d2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Creating volume 10ec34ff-e44f-4a5c-9a8e-21cf1dad609c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:36:58 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:58 devstack sudo[87223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c 1073741824
Apr 10 10:36:58 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['1b5e3fab-f7bb-4197-b541-ac2cfec9adf2', '312f17e3-737d-4724-b9e2-8cdd4f089d94', 'a4dc5e71-973e-49aa-9c24-7225a5b7cf7b', 'b9e7c740-62e6-4ae9-ba92-655da532412f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:58 devstack sudo[87225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:36:58 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:58 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582.528577bd-4be7-402c-8c73-d987238c2c6f" returned: 0 in 0.576s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-quobyte-528577bd-4be7-402c-8c73-d987238c2c6f" released by "_delete_snapshot" :: held 2.833s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" released by "delete_snapshot" :: held 2.852s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-0ef672e4-30e3-4188-9ade-d00b686f3feb-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Created reservations ['08ff22a5-d973-4e0e-9f63-1d037983c275', '893b6e88-f6f2-42cc-964a-e1dbf2b6d189', 'de97a879-cb40-43bd-ade2-651e48bc3d8e', 'b7cc2238-53d2-4dd1-835f-2db51449fc06'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-0ef672e4-30e3-4188-9ade-d00b686f3feb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-68731cbc-686b-4a1a-a031-462b88a5778f" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-68731cbc-686b-4a1a-a031-462b88a5778f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-0ef672e4-30e3-4188-9ade-d00b686f3feb" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0ef672e4-30e3-4188-9ade-d00b686f3feb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Deleting offline snapshot 0ef672e4-30e3-4188-9ade-d00b686f3feb of volume 68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] snapshot_file for this snap is: volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1007f26-bf76-47ad-a7e2-94f1aede2436]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:59 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Delete snapshot completed successfully.
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-27539948-084c-4ce1-b394-16a29891d6d6 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-528577bd-4be7-402c-8c73-d987238c2c6f-delete_snapshot" released by "delete_snapshot" :: held 3.055s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:59 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb
Apr 10 10:36:59 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:59 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.546s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:36:59 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Deleted volume successfully.
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3a222a1d-57af-41b7-a22f-03ddabfd7486 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-260a5685-3250-4c26-ad30-8724ff7004a9-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:36:59 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c 1073741824" returned: 0 in 0.808s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "cinder-87685e04-1db5-4330-a9d6-d19fd518d582-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-87685e04-1db5-4330-a9d6-d19fd518d582-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:36:59 devstack sudo[87234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c
Apr 10 10:36:59 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e156714f-b73f-40ec-8e2e-72f9be186690]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:59 devstack sudo[87237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582
Apr 10 10:36:59 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:36:59 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb" returned: 0 in 0.639s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68731cbc-686b-4a1a-a031-462b88a5778f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a206129-a94c-4c8f-a2fd-3ec6671687db]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:36:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:36:59 devstack sudo[87242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f
Apr 10 10:36:59 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:00 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c" returned: 0 in 0.595s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3453d9-b9d9-44d8-9671-c3292548ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5170692-b59c-4619-9bcc-6f5422c3400b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:00 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Volume volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c (10ec34ff-e44f-4a5c-9a8e-21cf1dad609c): created successfully
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5170692-b59c-4619-9bcc-6f5422c3400b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Flow 'volume_create_manager' (4fed89ca-61f8-461e-8c7b-7ffec2c59388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:00 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b396c1e2-4efe-4205-b731-c3329a1c5a01 tempest-VolumesNegativeTest-2046782045 None] Created volume successfully.
Apr 10 10:37:00 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582" returned: 0 in 0.627s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:00 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582
Apr 10 10:37:00 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:00 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f" returned: 0 in 0.700s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:00 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb
Apr 10 10:37:00 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:00 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-87685e04-1db5-4330-a9d6-d19fd518d582" returned: 0 in 0.567s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-quobyte-87685e04-1db5-4330-a9d6-d19fd518d582" released by "delete_volume" :: held 1.253s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Created reservations ['47122648-d165-4884-b473-7a896e90efc0', '0e743f51-fde1-463f-a662-2a780d797a56', 'b0291ef8-6d32-4a3c-b703-e6d480605ed4', 'f285eeaf-a494-412e-8e82-363521488224'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:00 devstack sudo[87256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:00 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:01 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb" returned: 0 in 0.601s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:01 devstack sudo[87261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb
Apr 10 10:37:01 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:01 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.546s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:01 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Deleted volume successfully.
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e4a1a9a7-3541-4ccd-b265-925ecdd0d3e2 tempest-SnapshotsActionsTest-619975053 None] Lock "cinder-87685e04-1db5-4330-a9d6-d19fd518d582-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:01 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f.0ef672e4-30e3-4188-9ade-d00b686f3feb" returned: 0 in 0.504s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0ef672e4-30e3-4188-9ade-d00b686f3feb" released by "_delete_snapshot" :: held 2.518s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-68731cbc-686b-4a1a-a031-462b88a5778f" released by "delete_snapshot" :: held 2.538s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['6fc1b2d8-5ac7-4b9f-8515-8661bf1b6d79', '13a96333-bddb-4cea-9a8f-6e027fc1b703', 'b14e83c0-593c-439d-8171-f2020413a0e9', 'f36faa84-89c1-42ba-a864-c56dad83ce49'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:01 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Delete snapshot completed successfully.
Apr 10 10:37:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-243e5881-be8b-4bd8-b4b7-a517f913d2e3 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-0ef672e4-30e3-4188-9ade-d00b686f3feb-delete_snapshot" released by "delete_snapshot" :: held 2.663s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-68731cbc-686b-4a1a-a031-462b88a5778f-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-68731cbc-686b-4a1a-a031-462b88a5778f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-68731cbc-686b-4a1a-a031-462b88a5778f" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-68731cbc-686b-4a1a-a031-462b88a5778f" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5940e82-dbf7-4db7-9ede-84d40077a798]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:02 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f
Apr 10 10:37:02 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:02 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f" returned: 0 in 0.622s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:02 devstack sudo[87270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f
Apr 10 10:37:02 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:03 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-68731cbc-686b-4a1a-a031-462b88a5778f" returned: 0 in 0.492s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-68731cbc-686b-4a1a-a031-462b88a5778f" released by "delete_volume" :: held 1.154s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['dc9035da-a0c1-4f1b-aabe-c32e7e775868', 'caf70ef8-96d2-4359-9b0d-dd1fe9b9bf3c', 'f6bcbf4f-46f9-4ae8-8407-e8e34f797646', 'c7f409e5-e3b6-44bf-8953-151630ef75f9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:03 devstack sudo[87273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:03 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:04 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.551s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:04 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Deleted volume successfully.
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-834b73a6-7b01-4723-a31a-f7f0d72c3729 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-68731cbc-686b-4a1a-a031-462b88a5778f-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (9b3a65b6-fdef-47d7-a4bb-80c9ca898d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6d6a93-c803-4921-99be-5d4564333b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6d6a93-c803-4921-99be-5d4564333b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-323360179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:05Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf820c1c-4dd4-4f58-9895-c866693ccfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf820c1c-4dd4-4f58-9895-c866693ccfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35efc799-d2fb-4b28-ad6c-e51ae4882026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35efc799-d2fb-4b28-ad6c-e51ae4882026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22', 'volume_name': 'volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2650a9d6-76c3-409c-bcff-7fe69e3f20db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2650a9d6-76c3-409c-bcff-7fe69e3f20db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc7c216-1925-43d4-834d-4f33d04bf966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:04 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume 1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22', 'volume_size': 1}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-323360179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:05Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Creating volume 1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:04 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:04 devstack sudo[87276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 1073741824
Apr 10 10:37:04 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:05 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 1073741824" returned: 0 in 0.586s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:05 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22
Apr 10 10:37:05 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:06 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc7c216-1925-43d4-834d-4f33d04bf966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb47559-1e02-429e-96fd-609cf1265c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:06 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 (1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22): created successfully
Apr 10 10:37:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb47559-1e02-429e-96fd-609cf1265c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:06 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (9b3a65b6-fdef-47d7-a4bb-80c9ca898d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:06 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3fd3f26b-b28e-4aa5-8616-c7cd685c87d6 tempest-VolumesSnapshotTestJSON-1045750709 None] Created volume successfully.
Apr 10 10:37:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Creating offline snapshot 0b040dce-fa74-4e0f-8f8c-9161a83256dd of volume 1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:37:07 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4bc7f8-319a-4d1d-9aff-10d7e7ec34c3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:07 devstack sudo[87285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22
Apr 10 10:37:07 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:07 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" returned: 0 in 0.627s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:07 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd 1G
Apr 10 10:37:07 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:08 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd 1G" returned: 0 in 0.536s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:08 devstack sudo[87311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd
Apr 10 10:37:08 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:08 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd" returned: 0 in 0.507s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:08 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd is being set with open permissions: ugo+rw
Apr 10 10:37:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:08 devstack sudo[87316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd
Apr 10 10:37:08 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:09 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd" returned: 0 in 0.502s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:09 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.info
Apr 10 10:37:09 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:09 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.info" returned: 0 in 0.540s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:09 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.info is being set with open permissions: ugo+rw
Apr 10 10:37:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:09 devstack sudo[87323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.info
Apr 10 10:37:09 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:10 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.info" returned: 0 in 0.571s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.362s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:10 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1e9fbf41-bac1-458e-b1a0-1a86a5c535fa tempest-VolumesSnapshotTestJSON-1045750709 None] Create snapshot completed successfully
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (b74e219d-a62f-423b-bc4a-8c492acc7c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54226d70-957b-45db-ba5b-53cea9805535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54226d70-957b-45db-ba5b-53cea9805535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903348916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de030bb0-d0da-469a-912c-93d3cc1a4509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cc8d0af5ef4c8db206e531c06590cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b040dce-fa74-4e0f-8f8c-9161a83256dd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:12Z,use_quota=True,user_id='344e0a8691cc43fc90fda7a5acab18db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603f74b6-015c-4079-be7d-f1ee5a35e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603f74b6-015c-4079-be7d-f1ee5a35e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a892dd15-1887-41f3-8a01-03c0a7a7f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a892dd15-1887-41f3-8a01-03c0a7a7f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de030bb0-d0da-469a-912c-93d3cc1a4509', 'volume_name': 'volume-de030bb0-d0da-469a-912c-93d3cc1a4509', 'volume_size': 1, 'snapshot_id': '0b040dce-fa74-4e0f-8f8c-9161a83256dd'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7548db05-ff6b-4698-8185-c1daa0f95bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7548db05-ff6b-4698-8185-c1daa0f95bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6999d5-fb39-4194-9271-695129213a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:11 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume de030bb0-d0da-469a-912c-93d3cc1a4509: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de030bb0-d0da-469a-912c-93d3cc1a4509', 'volume_size': 1, 'snapshot_id': '0b040dce-fa74-4e0f-8f8c-9161a83256dd'}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-0b040dce-fa74-4e0f-8f8c-9161a83256dd-de030bb0-d0da-469a-912c-93d3cc1a4509" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0b040dce-fa74-4e0f-8f8c-9161a83256dd-de030bb0-d0da-469a-912c-93d3cc1a4509" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Creating volume de030bb0-d0da-469a-912c-93d3cc1a4509 from snapshot 0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-de030bb0-d0da-469a-912c-93d3cc1a4509" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-de030bb0-d0da-469a-912c-93d3cc1a4509" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] snapshot: 0b040dce-fa74-4e0f-8f8c-9161a83256dd, volume: de030bb0-d0da-469a-912c-93d3cc1a4509,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5fcd9-7e1a-4e71-8479-83752138f672]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:11 devstack sudo[87329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd
Apr 10 10:37:11 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:12 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd" returned: 0 in 0.674s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[789419cc-c5db-495d-b245-ee93f86cb7ec]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Flow 'volume_create_manager' (341f654c-7c01-4312-bb91-47619149a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823df5da-9c3e-43b9-921d-a97df416f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823df5da-9c3e-43b9-921d-a97df416f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-447969991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e1a059-f0d9-428d-9f07-b5d1d299672b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2289a8caa5f4f2c8597b527e518ca17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:13Z,use_quota=True,user_id='5c7ad1807c8e41f2a2a08515e9b5bc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(037626b9-7129-4dbd-99ca-c7d945e30596),volume_type_id=037626b9-7129-4dbd-99ca-c7d945e30596)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:12 devstack sudo[87358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22
Apr 10 10:37:12 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89beafe2-2194-4aaf-813c-e37cc1d49ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89beafe2-2194-4aaf-813c-e37cc1d49ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8d8833-4caa-42c8-921b-e5da260a71b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8d8833-4caa-42c8-921b-e5da260a71b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e1a059-f0d9-428d-9f07-b5d1d299672b', 'volume_name': 'volume-95e1a059-f0d9-428d-9f07-b5d1d299672b', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b53a1b-d8ba-4478-96c9-1ea127c43cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b53a1b-d8ba-4478-96c9-1ea127c43cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50f6347-f0dd-43d7-859f-ff9e1ca25c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:12 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Volume 95e1a059-f0d9-428d-9f07-b5d1d299672b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e1a059-f0d9-428d-9f07-b5d1d299672b', 'volume_size': 1}
Apr 10 10:37:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:13 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" returned: 0 in 0.721s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:13 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:37:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:13 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509
Apr 10 10:37:13 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:16 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509" returned: 0 in 2.795s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:16 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68402d4-9b78-4c08-80c0-f45177eaf2b4]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:16 devstack sudo[87378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22
Apr 10 10:37:16 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:16 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" returned: 0 in 0.709s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:16 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22, size 1024.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:37:16 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Converted 1024.00 MB image at 366.22 MB/s
Apr 10 10:37:16 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509 is being set with open permissions: ugo+rw
Apr 10 10:37:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:16 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509
Apr 10 10:37:16 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:17 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509" returned: 0 in 0.524s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-de030bb0-d0da-469a-912c-93d3cc1a4509" released by "_copy_volume_from_snapshot" :: held 5.503s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0b040dce-fa74-4e0f-8f8c-9161a83256dd-de030bb0-d0da-469a-912c-93d3cc1a4509" released by "_create_volume_from_snapshot" :: held 5.525s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.536s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.578s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-447969991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e1a059-f0d9-428d-9f07-b5d1d299672b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2289a8caa5f4f2c8597b527e518ca17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:13Z,use_quota=True,user_id='5c7ad1807c8e41f2a2a08515e9b5bc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(037626b9-7129-4dbd-99ca-c7d945e30596),volume_type_id=037626b9-7129-4dbd-99ca-c7d945e30596)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Creating volume 95e1a059-f0d9-428d-9f07-b5d1d299672b {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:17 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:17 devstack sudo[87410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b 1073741824
Apr 10 10:37:17 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6999d5-fb39-4194-9271-695129213a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de030bb0-d0da-469a-912c-93d3cc1a4509', 'volume_size': 1, 'snapshot_id': '0b040dce-fa74-4e0f-8f8c-9161a83256dd'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25909c4b-d5c0-4bff-87a7-481541c2c622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Volume volume-de030bb0-d0da-469a-912c-93d3cc1a4509 (de030bb0-d0da-469a-912c-93d3cc1a4509): created successfully
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25909c4b-d5c0-4bff-87a7-481541c2c622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Flow 'volume_create_manager' (b74e219d-a62f-423b-bc4a-8c492acc7c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:17 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-88dc3bc4-6997-431f-a164-144714ea5503 tempest-VolumesSnapshotTestJSON-1045750709 None] Created volume successfully.
Apr 10 10:37:17 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b 1073741824" returned: 0 in 0.542s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:17 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b
Apr 10 10:37:17 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-de030bb0-d0da-469a-912c-93d3cc1a4509-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-de030bb0-d0da-469a-912c-93d3cc1a4509-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:18 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b" returned: 0 in 0.564s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50f6347-f0dd-43d7-859f-ff9e1ca25c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e1a059-f0d9-428d-9f07-b5d1d299672b', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e138bb-d404-45fb-a461-adeb777a8b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-de030bb0-d0da-469a-912c-93d3cc1a4509" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-de030bb0-d0da-469a-912c-93d3cc1a4509" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:18 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Volume volume-95e1a059-f0d9-428d-9f07-b5d1d299672b (95e1a059-f0d9-428d-9f07-b5d1d299672b): created successfully
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e138bb-d404-45fb-a461-adeb777a8b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Flow 'volume_create_manager' (341f654c-7c01-4312-bb91-47619149a404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[0899c7ad-a6ca-4715-b17d-44f49c95f364]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:18 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9018abca-2bee-4f56-95e6-1700754ccfe1 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Created volume successfully.
Apr 10 10:37:18 devstack sudo[87419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509
Apr 10 10:37:18 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:19 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509" returned: 0 in 0.488s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:19 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509
Apr 10 10:37:19 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:19 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:19 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:19 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-de030bb0-d0da-469a-912c-93d3cc1a4509" returned: 0 in 0.543s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-de030bb0-d0da-469a-912c-93d3cc1a4509" released by "delete_volume" :: held 1.071s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['e3da1b7a-a849-4f2f-b2d7-901e8b0aa717', '56ddd9e1-502c-463c-9fc6-afaa0ff902dd', 'e6582af2-a82b-46d9-a961-dbe1f92b2faa', '463bbd01-6b20-4e0a-b440-b4f5e7132d25'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:19 devstack sudo[87432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:19 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:20 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.498s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:20 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-8eed6ce5-6485-434f-b855-e46b4a0a3d35 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Retype volume completed successfully.
Apr 10 10:37:20 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.462s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:20 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Deleted volume successfully.
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-13ee2d7f-73a3-4b2a-ab19-05b5f35253e0 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-de030bb0-d0da-469a-912c-93d3cc1a4509-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Acquiring lock "cinder-95e1a059-f0d9-428d-9f07-b5d1d299672b-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "cinder-95e1a059-f0d9-428d-9f07-b5d1d299672b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Acquiring lock "cinder-quobyte-95e1a059-f0d9-428d-9f07-b5d1d299672b" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "cinder-quobyte-95e1a059-f0d9-428d-9f07-b5d1d299672b" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-0b040dce-fa74-4e0f-8f8c-9161a83256dd-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fadc38-4960-4646-b48e-06dfd1766ee2]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-0b040dce-fa74-4e0f-8f8c-9161a83256dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-0b040dce-fa74-4e0f-8f8c-9161a83256dd" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0b040dce-fa74-4e0f-8f8c-9161a83256dd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Deleting offline snapshot 0b040dce-fa74-4e0f-8f8c-9161a83256dd of volume 1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] snapshot_file for this snap is: volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ef4697-61f8-45f0-9523-4f49516214e1]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:21 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b
Apr 10 10:37:21 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:21 devstack sudo[87437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd
Apr 10 10:37:21 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:21 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b" returned: 0 in 0.521s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:21 devstack sudo[87445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b
Apr 10 10:37:21 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:21 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd" returned: 0 in 0.572s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:37:21 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e237247a-ddbc-4c2b-b7d7-28aae41efa18]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:21 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22
Apr 10 10:37:21 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:22 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-95e1a059-f0d9-428d-9f07-b5d1d299672b" returned: 0 in 0.566s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "cinder-quobyte-95e1a059-f0d9-428d-9f07-b5d1d299672b" released by "delete_volume" :: held 1.119s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:22 devstack cinder-volume[81969]: WARNING cinder.quota [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:37:22 devstack cinder-volume[81969]: WARNING cinder.quota [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Created reservations ['37a3c7d4-2e9a-4530-95fe-32bb001a6a0b', '20b6e828-abb2-40cf-90dc-c0e81058fce0', '96f013db-ddf7-407e-9b99-581e3a841a17', '4aacf922-c5e7-4ec5-9e42-5a770b2131ec'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:22 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:22 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:22 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" returned: 0 in 0.648s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:22 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd
Apr 10 10:37:22 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:22 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.544s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:22 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Deleted volume successfully.
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c5b03f14-47a4-4d26-906c-eb7041f94691 tempest-VolumeRetypeWithoutMigrationTest-681884163 None] Lock "cinder-95e1a059-f0d9-428d-9f07-b5d1d299672b-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:22 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd" returned: 0 in 0.615s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:22 devstack sudo[87462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd
Apr 10 10:37:22 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:23 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22.0b040dce-fa74-4e0f-8f8c-9161a83256dd" returned: 0 in 0.517s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-0b040dce-fa74-4e0f-8f8c-9161a83256dd" released by "_delete_snapshot" :: held 2.419s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" released by "delete_snapshot" :: held 2.433s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:23 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['e7cfc0c5-7359-4f3b-a460-c333a5e03a11', 'bcd70c65-988b-47c8-9fd1-3e32e5b6219e', 'ae50c5d1-8531-469c-94bb-7131dafcf047', '27b20e4c-0d5d-405f-a99b-97179e7d1c14'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:23 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Delete snapshot completed successfully.
Apr 10 10:37:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab166b72-8487-4f2f-8ec9-c19635a7aa9a tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-0b040dce-fa74-4e0f-8f8c-9161a83256dd-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da8213c-b430-46bd-b15d-eccc57a23191]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:24 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22
Apr 10 10:37:24 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:24 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" returned: 0 in 0.640s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:24 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22
Apr 10 10:37:24 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:25 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22" released by "delete_volume" :: held 1.251s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['adb88a2a-1a6d-4477-bb82-32c9bccb3bb3', 'ddd1a7cd-0399-4628-b09b-39cc95de7c04', '1e049392-7b93-45ab-b592-7600cafc55f1', '1f8e96d1-c15b-41bd-8dd8-a9f0efbbdbe9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:25 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:25 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:26 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.535s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:26 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Deleted volume successfully.
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3cc0bda6-cf82-4c00-a5b0-d58d374f3c3e tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-1ad99dcb-9b84-4bd7-ae6e-eb4078ffea22-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-f7d5672c-a669-4377-a904-8fd06f9e215e-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-f7d5672c-a669-4377-a904-8fd06f9e215e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "cinder-quobyte-f7d5672c-a669-4377-a904-8fd06f9e215e" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-f7d5672c-a669-4377-a904-8fd06f9e215e" acquired by "delete_volume" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379ce43-261e-4f1c-a321-92ad4619ac9f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:26 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e
Apr 10 10:37:26 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:27 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e" returned: 0 in 0.642s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:27 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e
Apr 10 10:37:27 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Acquiring lock "cinder-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Lock "cinder-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Acquiring lock "cinder-quobyte-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Lock "cinder-quobyte-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bc05d8-d5a4-419a-96bb-a57963186324]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:27 devstack sudo[87487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c
Apr 10 10:37:27 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:27 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-f7d5672c-a669-4377-a904-8fd06f9e215e" returned: 0 in 0.521s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-quobyte-f7d5672c-a669-4377-a904-8fd06f9e215e" released by "delete_volume" :: held 1.214s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Created reservations ['1a15666d-5a8f-45a9-aabb-0e56ead315bb', '5fdc2921-5f73-4dac-b29c-5b1db14225c8', '2f3ccd7a-47d8-45f3-8dc9-69934d8f8869', '2a050f8f-1d07-4df4-936f-a56b2e9d59ee'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Flow 'volume_create_manager' (39369cbb-d2e4-4e16-9501-36531d03a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f47256-597d-4425-a014-5af7a71e4ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f47256-597d-4425-a014-5af7a71e4ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1157911864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c867077-83e4-4864-8a94-46498b20b7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1076dd885a6f471b90b5bd653882b072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:28Z,use_quota=True,user_id='03c2ecc0a6e9462e9c0d87cc6be8160c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec0f550b-92e4-4caf-88f2-7aef5272fdcc),volume_type_id=ec0f550b-92e4-4caf-88f2-7aef5272fdcc)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a9a513-357d-4a31-8674-3ddafcdc55b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a9a513-357d-4a31-8674-3ddafcdc55b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4481a2c0-ef77-427a-82c4-fc46ed4fefcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4481a2c0-ef77-427a-82c4-fc46ed4fefcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c867077-83e4-4864-8a94-46498b20b7f7', 'volume_name': 'volume-1c867077-83e4-4864-8a94-46498b20b7f7', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d295063a-dd41-4d51-9e58-1fb94c935ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d295063a-dd41-4d51-9e58-1fb94c935ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c67e8ba-61e4-433d-ad3b-6191aed8d4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:27 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Volume 1c867077-83e4-4864-8a94-46498b20b7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c867077-83e4-4864-8a94-46498b20b7f7', 'volume_size': 1}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1157911864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c867077-83e4-4864-8a94-46498b20b7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1076dd885a6f471b90b5bd653882b072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:28Z,use_quota=True,user_id='03c2ecc0a6e9462e9c0d87cc6be8160c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec0f550b-92e4-4caf-88f2-7aef5272fdcc),volume_type_id=ec0f550b-92e4-4caf-88f2-7aef5272fdcc)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Creating volume 1c867077-83e4-4864-8a94-46498b20b7f7 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:28 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:28 devstack sudo[87493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7 1073741824
Apr 10 10:37:28 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:28 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:28 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:28 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c" returned: 0 in 0.619s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:28 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c
Apr 10 10:37:28 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:28 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.460s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Deleted volume successfully.
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1e19086f-1a1f-4dcb-9379-daa43befccd1 tempest-VolumesSnapshotTestJSON-1045750709 None] Lock "cinder-f7d5672c-a669-4377-a904-8fd06f9e215e-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:28 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c" returned: 0 in 0.488s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Lock "cinder-quobyte-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c" released by "delete_volume" :: held 1.130s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:28 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7 1073741824" returned: 0 in 0.584s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Created reservations ['c413ead5-4b4b-44be-83d1-183fe64b5b41', '27a2f090-89d7-4474-b574-645e1cf3e15c', 'e6256cce-a80a-4145-9236-f9ec481f5415', 'a297404d-f3b4-47d1-93ed-8ad9796f8bb9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:28 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7
Apr 10 10:37:28 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:28 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:28 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:29 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7" returned: 0 in 0.502s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c67e8ba-61e4-433d-ad3b-6191aed8d4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c867077-83e4-4864-8a94-46498b20b7f7', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5672b799-156a-448b-9a9f-e657d5a0a75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:29 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Volume volume-1c867077-83e4-4864-8a94-46498b20b7f7 (1c867077-83e4-4864-8a94-46498b20b7f7): created successfully
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5672b799-156a-448b-9a9f-e657d5a0a75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Flow 'volume_create_manager' (39369cbb-d2e4-4e16-9501-36531d03a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e6a6d3f7-e91c-4655-abf0-846c4ddf4227 tempest-VolumeTypesAccessTest-1626770575 None] Created volume successfully.
Apr 10 10:37:29 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.486s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Deleted volume successfully.
Apr 10 10:37:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c19e38ed-3571-4f76-a558-5fb8ca4dbd20 tempest-VolumesNegativeTest-2046782045 None] Lock "cinder-10ec34ff-e44f-4a5c-9a8e-21cf1dad609c-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Acquiring lock "cinder-1c867077-83e4-4864-8a94-46498b20b7f7-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Lock "cinder-1c867077-83e4-4864-8a94-46498b20b7f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Acquiring lock "cinder-quobyte-1c867077-83e4-4864-8a94-46498b20b7f7" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Lock "cinder-quobyte-1c867077-83e4-4864-8a94-46498b20b7f7" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491da90-5bb3-40ff-8c16-c58515d5d738]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:30 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7
Apr 10 10:37:30 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:30 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7" returned: 0 in 0.778s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:31 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7
Apr 10 10:37:31 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:31 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-1c867077-83e4-4864-8a94-46498b20b7f7" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Lock "cinder-quobyte-1c867077-83e4-4864-8a94-46498b20b7f7" released by "delete_volume" :: held 1.384s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:31 devstack cinder-volume[81969]: WARNING cinder.quota [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-291238681 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-291238681, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:37:31 devstack cinder-volume[81969]: WARNING cinder.quota [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-291238681 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-291238681, it is now deprecated. Please use the default quota class for default quota.
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Created reservations ['71d7ef43-2dff-45ce-b85b-6f683e6e2c9f', '06d71358-eb40-4030-83c8-531f51da22f5', 'f99fdf08-811b-4f4a-87b9-44d6277105cf', '6d4414d0-5740-4d10-ad33-1daf4473f83c'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:31 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:31 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:32 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.543s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:32 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:32 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Deleted volume successfully.
Apr 10 10:37:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fb5f0575-b855-4fd3-a258-8f6896b1424f tempest-VolumeTypesAccessTest-1626770575 None] Lock "cinder-1c867077-83e4-4864-8a94-46498b20b7f7-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (d99f348b-3dd5-464b-93eb-4215a3560035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf1a33f-e93f-45e4-9680-0840ab6d4e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf1a33f-e93f-45e4-9680-0840ab6d4e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892080617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641b8efe-8ea4-4632-96b3-f335c3f47924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f0ed6e-1ce7-4585-a4c8-eae02d0fb249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f0ed6e-1ce7-4585-a4c8-eae02d0fb249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0458da2c-9ab1-44b9-a56f-813984629a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0458da2c-9ab1-44b9-a56f-813984629a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641b8efe-8ea4-4632-96b3-f335c3f47924', 'volume_name': 'volume-641b8efe-8ea4-4632-96b3-f335c3f47924', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4bdb65-9232-4ce7-9972-23c9950e7043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4bdb65-9232-4ce7-9972-23c9950e7043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1f5624-5231-4254-807d-66163d99c1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:33 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Volume 641b8efe-8ea4-4632-96b3-f335c3f47924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641b8efe-8ea4-4632-96b3-f335c3f47924', 'volume_size': 1}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892080617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641b8efe-8ea4-4632-96b3-f335c3f47924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Creating volume 641b8efe-8ea4-4632-96b3-f335c3f47924 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:33 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:33 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924 1073741824
Apr 10 10:37:33 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (f2528b34-f2a7-4b27-bbf9-dee636b93df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89459c43-d0f1-4713-947c-fff000d339ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89459c43-d0f1-4713-947c-fff000d339ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892640684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2ad060-ab6e-41d2-b910-5c9b60b74daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803ac496-150f-47dd-b81d-0b4ef096b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803ac496-150f-47dd-b81d-0b4ef096b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7895734-d9a4-457d-b293-fee9c1930dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7895734-d9a4-457d-b293-fee9c1930dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2ad060-ab6e-41d2-b910-5c9b60b74daa', 'volume_name': 'volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797e2016-e629-4665-9e8c-1509db591b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797e2016-e629-4665-9e8c-1509db591b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f2b1d8-ae03-4ecb-9581-a9ffb5d065dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Volume ab2ad060-ab6e-41d2-b910-5c9b60b74daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa', 'volume_size': 1}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (7952f6a6-810b-458b-b2e5-41c28391c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21163980-308b-4f71-acca-507be4bf5798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21163980-308b-4f71-acca-507be4bf5798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850936275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdeb8814-e247-452e-bab4-4e2420a19d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7792584c-daae-4afb-a8f4-5454fb5bac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7792584c-daae-4afb-a8f4-5454fb5bac97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3efda1-cba9-4e66-b170-e3d52a2d450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3efda1-cba9-4e66-b170-e3d52a2d450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdeb8814-e247-452e-bab4-4e2420a19d39', 'volume_name': 'volume-bdeb8814-e247-452e-bab4-4e2420a19d39', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003af0d0-f667-4ad9-9247-8707cb71f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003af0d0-f667-4ad9-9247-8707cb71f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81676c09-0950-4a4d-8457-c14d4a6cb792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Volume bdeb8814-e247-452e-bab4-4e2420a19d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdeb8814-e247-452e-bab4-4e2420a19d39', 'volume_size': 1}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (527d9214-c79b-4d18-aae6-6b3f8776410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8db42b1-3494-47ff-a188-dadc2856c222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924 1073741824" returned: 0 in 0.801s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8db42b1-3494-47ff-a188-dadc2856c222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610870878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7049d2-4ee9-498e-bcef-71ec0f5fed79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:35Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53339ba3-72b3-4671-a6a9-07cf00a90a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53339ba3-72b3-4671-a6a9-07cf00a90a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac62ad64-6de2-4696-a1fe-47cd24615608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac62ad64-6de2-4696-a1fe-47cd24615608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7049d2-4ee9-498e-bcef-71ec0f5fed79', 'volume_name': 'volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a169a34-e256-468c-af1a-2408db64001a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a169a34-e256-468c-af1a-2408db64001a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f476dbb3-c5d6-48f0-a620-fb3cfb9d082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Volume 4d7049d2-4ee9-498e-bcef-71ec0f5fed79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79', 'volume_size': 1}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:34 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924
Apr 10 10:37:34 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (4e5c11a9-7a77-45b3-abec-e072deef8896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0e6e1b-2297-4c61-8b9c-f9acb110fe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0e6e1b-2297-4c61-8b9c-f9acb110fe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171900000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f42b0e-7008-47ad-a855-105b2f97b621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:35Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115a8ead-b190-4a9d-ba19-bd65c8ed7a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115a8ead-b190-4a9d-ba19-bd65c8ed7a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ec4613-94bb-4d3f-ac86-73db65a574bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ec4613-94bb-4d3f-ac86-73db65a574bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f42b0e-7008-47ad-a855-105b2f97b621', 'volume_name': 'volume-00f42b0e-7008-47ad-a855-105b2f97b621', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae6084-7bc8-4e60-af24-dc332d33834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae6084-7bc8-4e60-af24-dc332d33834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b70dae-fc64-4734-a038-78cc99a4b4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Volume 00f42b0e-7008-47ad-a855-105b2f97b621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f42b0e-7008-47ad-a855-105b2f97b621', 'volume_size': 1}
Apr 10 10:37:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:35 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924" returned: 0 in 0.557s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892640684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2ad060-ab6e-41d2-b910-5c9b60b74daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Creating volume ab2ad060-ab6e-41d2-b910-5c9b60b74daa {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:35 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1f5624-5231-4254-807d-66163d99c1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641b8efe-8ea4-4632-96b3-f335c3f47924', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:35 devstack sudo[87532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa 1073741824
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4809c17-1726-408b-88db-0cb954e4e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:35 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:35 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Volume volume-641b8efe-8ea4-4632-96b3-f335c3f47924 (641b8efe-8ea4-4632-96b3-f335c3f47924): created successfully
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4809c17-1726-408b-88db-0cb954e4e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (d99f348b-3dd5-464b-93eb-4215a3560035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:35 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b49c9b2b-cb48-4b8c-ab91-f53116a6d536 tempest-CreateVolumesFromImageTest-1059521794 None] Created volume successfully.
Apr 10 10:37:35 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa 1073741824" returned: 0 in 0.567s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:35 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa
Apr 10 10:37:35 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:36 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa" returned: 0 in 0.525s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850936275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdeb8814-e247-452e-bab4-4e2420a19d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Creating volume bdeb8814-e247-452e-bab4-4e2420a19d39 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:36 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f2b1d8-ae03-4ecb-9581-a9ffb5d065dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b0fd78-ffe5-4a65-96c7-65e590c2bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:36 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39 1073741824
Apr 10 10:37:36 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:36 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Volume volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa (ab2ad060-ab6e-41d2-b910-5c9b60b74daa): created successfully
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b0fd78-ffe5-4a65-96c7-65e590c2bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (f2528b34-f2a7-4b27-bbf9-dee636b93df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a898f115-3a68-4fae-8df9-bc2dffcc799d tempest-CreateVolumesFromImageTest-1059521794 None] Created volume successfully.
Apr 10 10:37:37 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39 1073741824" returned: 0 in 0.659s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:37 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39
Apr 10 10:37:37 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:37 devstack sudo[87547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:37 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:37 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39" returned: 0 in 0.535s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.949s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610870878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7049d2-4ee9-498e-bcef-71ec0f5fed79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:35Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Creating volume 4d7049d2-4ee9-498e-bcef-71ec0f5fed79 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:37 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81676c09-0950-4a4d-8457-c14d4a6cb792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdeb8814-e247-452e-bab4-4e2420a19d39', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7affae1c-7f4d-41d5-a9ce-d5df8a04d055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:37 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79 1073741824
Apr 10 10:37:37 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:37 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Volume volume-bdeb8814-e247-452e-bab4-4e2420a19d39 (bdeb8814-e247-452e-bab4-4e2420a19d39): created successfully
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7affae1c-7f4d-41d5-a9ce-d5df8a04d055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (7952f6a6-810b-458b-b2e5-41c28391c25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:37 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-729fa5f4-b414-404b-8136-dffb13506b40 tempest-CreateVolumesFromImageTest-1059521794 None] Created volume successfully.
Apr 10 10:37:38 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.642s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:38 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79 1073741824" returned: 0 in 0.742s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:38 devstack sudo[87556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79
Apr 10 10:37:38 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:38 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79" returned: 0 in 0.534s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.977s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171900000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f42b0e-7008-47ad-a855-105b2f97b621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323af9ba22534fbcaa632631cf731c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:35Z,use_quota=True,user_id='7c6b72dff5944e3f89ae7f98ad17e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Creating volume 00f42b0e-7008-47ad-a855-105b2f97b621 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:38 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f476dbb3-c5d6-48f0-a620-fb3cfb9d082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:39 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ff5fd-8925-4619-a2d7-e55a4206dfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:39 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621 1073741824
Apr 10 10:37:39 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:39 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Volume volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79 (4d7049d2-4ee9-498e-bcef-71ec0f5fed79): created successfully
Apr 10 10:37:39 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ff5fd-8925-4619-a2d7-e55a4206dfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:39 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (527d9214-c79b-4d18-aae6-6b3f8776410e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:39 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a55a6691-5062-438d-8853-d64dd167d772 tempest-CreateVolumesFromImageTest-1059521794 None] Created volume successfully.
Apr 10 10:37:39 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621 1073741824" returned: 0 in 0.691s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:39 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621
Apr 10 10:37:39 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:40 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621" returned: 0 in 0.517s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b70dae-fc64-4734-a038-78cc99a4b4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f42b0e-7008-47ad-a855-105b2f97b621', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3656e8bc-3921-4783-bb88-e027c206f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:40 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Volume volume-00f42b0e-7008-47ad-a855-105b2f97b621 (00f42b0e-7008-47ad-a855-105b2f97b621): created successfully
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3656e8bc-3921-4783-bb88-e027c206f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Flow 'volume_create_manager' (4e5c11a9-7a77-45b3-abec-e072deef8896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:40 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d8f377c4-14f5-4e66-beee-c3b517c6be9b tempest-CreateVolumesFromImageTest-1059521794 None] Created volume successfully.
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-00f42b0e-7008-47ad-a855-105b2f97b621-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-00f42b0e-7008-47ad-a855-105b2f97b621-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-quobyte-00f42b0e-7008-47ad-a855-105b2f97b621" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-00f42b0e-7008-47ad-a855-105b2f97b621" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f58179-01f6-48cb-857b-823037f64cea]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:40 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621
Apr 10 10:37:40 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:41 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621" returned: 0 in 0.620s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:41 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621
Apr 10 10:37:41 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:41 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-00f42b0e-7008-47ad-a855-105b2f97b621" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-00f42b0e-7008-47ad-a855-105b2f97b621" released by "delete_volume" :: held 1.222s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Created reservations ['9d5662af-1f47-44a4-b24a-c041de4d7d5c', 'dcee1488-b4fa-47d6-9837-c6ef99a4f7d0', '00f6fa89-6da7-46cb-8421-2d462cee0142', '564cd3ce-885d-4ae1-b035-b05af64bd20c'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:41 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:41 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:42 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.538s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:42 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Deleted volume successfully.
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8075923c-0c9b-4c83-88b1-7aa7695eafac tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-00f42b0e-7008-47ad-a855-105b2f97b621-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-4d7049d2-4ee9-498e-bcef-71ec0f5fed79-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-4d7049d2-4ee9-498e-bcef-71ec0f5fed79-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-quobyte-4d7049d2-4ee9-498e-bcef-71ec0f5fed79" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-4d7049d2-4ee9-498e-bcef-71ec0f5fed79" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf6fbf-7567-4919-aa4b-d8a9cf6e10cd]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:42 devstack sudo[87579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79
Apr 10 10:37:42 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:43 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79" returned: 0 in 0.660s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:43 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79
Apr 10 10:37:43 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:43 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4d7049d2-4ee9-498e-bcef-71ec0f5fed79" returned: 0 in 0.541s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-4d7049d2-4ee9-498e-bcef-71ec0f5fed79" released by "delete_volume" :: held 1.232s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Created reservations ['6c08cf8e-cec2-4aa7-9114-b18e203cd3f7', '7a83ed94-7015-40b0-b3ca-d8126e3fe0fa', '1c5e3712-e648-41d4-bb5c-adf175d1fc87', 'fa2b2c7b-ff4e-44f1-b9b8-74aeb24c0070'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:44 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:44 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:44 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.475s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:44 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Deleted volume successfully.
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e8551fa4-e54b-4d0e-bccc-13927527bca5 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-4d7049d2-4ee9-498e-bcef-71ec0f5fed79-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-bdeb8814-e247-452e-bab4-4e2420a19d39-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-bdeb8814-e247-452e-bab4-4e2420a19d39-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-quobyte-bdeb8814-e247-452e-bab4-4e2420a19d39" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-bdeb8814-e247-452e-bab4-4e2420a19d39" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf417d-1394-46ac-9d05-da980ba2d8ce]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:44 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39
Apr 10 10:37:44 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Flow 'volume_create_manager' (688513ba-77d2-491f-8d99-0e4762661dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc88dbb-5451-4d13-b2d9-d88e515df905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc88dbb-5451-4d13-b2d9-d88e515df905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1445211060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010a6ebc-92f6-4d0c-a385-3a602d252b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fdcd15eda446428597e6f93373af63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:45Z,use_quota=True,user_id='b8975d618d2a4ecaa07be37b90c337d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4099cb4f-13b3-47fd-a5a3-04c8e9b032df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4099cb4f-13b3-47fd-a5a3-04c8e9b032df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3f3eb1-a8cd-4c57-b134-201e2f79441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3f3eb1-a8cd-4c57-b134-201e2f79441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010a6ebc-92f6-4d0c-a385-3a602d252b4c', 'volume_name': 'volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3c044a-e6f8-4ddd-8b1c-97ccba4f3cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3c044a-e6f8-4ddd-8b1c-97ccba4f3cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18dc89f4-b652-4224-9c66-4d2911fc2ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:45 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Volume 010a6ebc-92f6-4d0c-a385-3a602d252b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c', 'volume_size': 1}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1445211060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010a6ebc-92f6-4d0c-a385-3a602d252b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fdcd15eda446428597e6f93373af63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:45Z,use_quota=True,user_id='b8975d618d2a4ecaa07be37b90c337d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Creating volume 010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:45 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:45 devstack sudo[87592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c 1073741824
Apr 10 10:37:45 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:45 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39" returned: 0 in 0.593s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:45 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39
Apr 10 10:37:45 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:45 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c 1073741824" returned: 0 in 0.590s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:45 devstack sudo[87602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c
Apr 10 10:37:45 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:46 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bdeb8814-e247-452e-bab4-4e2420a19d39" returned: 0 in 0.554s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-bdeb8814-e247-452e-bab4-4e2420a19d39" released by "delete_volume" :: held 1.174s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Created reservations ['29d2b6cd-236e-414f-a399-551fe8e7b42a', '79151052-22f4-41c6-9752-ede410a1a07c', '16549beb-a44f-4246-b568-f88492af3e98', 'a61a87f3-76aa-40a5-80e9-4206a0b83485'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:46 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:46 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:46 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c" returned: 0 in 0.546s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18dc89f4-b652-4224-9c66-4d2911fc2ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab875820-f6a5-4d72-bde4-e252a81aadf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:46 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Volume volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c (010a6ebc-92f6-4d0c-a385-3a602d252b4c): created successfully
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab875820-f6a5-4d72-bde4-e252a81aadf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Flow 'volume_create_manager' (688513ba-77d2-491f-8d99-0e4762661dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-981c43b2-f2cd-4eec-bf05-6753d812c549 tempest-VolumesDeleteCascade-285388442 None] Created volume successfully.
Apr 10 10:37:46 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.498s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Deleted volume successfully.
Apr 10 10:37:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7608c798-285e-44e9-b647-adf01c8e7873 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-bdeb8814-e247-452e-bab4-4e2420a19d39-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-ab2ad060-ab6e-41d2-b910-5c9b60b74daa-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-ab2ad060-ab6e-41d2-b910-5c9b60b74daa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-quobyte-ab2ad060-ab6e-41d2-b910-5c9b60b74daa" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-ab2ad060-ab6e-41d2-b910-5c9b60b74daa" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0bd0fa-2cda-44cd-ba64-f0ecdb5916ad]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:47 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa
Apr 10 10:37:47 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Creating offline snapshot 88dd108b-fd65-4c87-9a59-922d85b340a7 of volume 010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[5413a3fc-1e97-4f40-9da2-ae5c1d7fee08]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:47 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c
Apr 10 10:37:47 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:47 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa" returned: 0 in 0.555s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:47 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa
Apr 10 10:37:47 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:48 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c" returned: 0 in 0.547s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:48 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 1G
Apr 10 10:37:48 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:48 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ab2ad060-ab6e-41d2-b910-5c9b60b74daa" returned: 0 in 0.431s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-ab2ad060-ab6e-41d2-b910-5c9b60b74daa" released by "delete_volume" :: held 1.018s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Created reservations ['e8e2cfe8-5e81-4c01-a576-57ff4b3ed57a', '55350379-2799-4513-ab87-055247632908', '8d65f149-e20e-4be6-91ed-b62460142906', 'b3f55308-3741-400f-9fd5-62d269a13407'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:48 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:48 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:48 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 1G" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:48 devstack sudo[87630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7
Apr 10 10:37:48 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:48 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.464s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Deleted volume successfully.
Apr 10 10:37:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-59324d70-fa82-43b4-a011-d841b3bb4171 tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-ab2ad060-ab6e-41d2-b910-5c9b60b74daa-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:49 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7" returned: 0 in 0.523s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:49 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 is being set with open permissions: ugo+rw
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:49 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7
Apr 10 10:37:49 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-641b8efe-8ea4-4632-96b3-f335c3f47924-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-641b8efe-8ea4-4632-96b3-f335c3f47924-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "cinder-quobyte-641b8efe-8ea4-4632-96b3-f335c3f47924" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-641b8efe-8ea4-4632-96b3-f335c3f47924" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37a8206-fde3-4bd7-8c5c-7266057a99b5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:49 devstack sudo[87644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924
Apr 10 10:37:49 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:49 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7" returned: 0 in 0.447s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:49 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.info
Apr 10 10:37:49 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:49 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924" returned: 0 in 0.563s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:49 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924
Apr 10 10:37:49 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:50 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.info" returned: 0 in 0.497s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:50 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.info is being set with open permissions: ugo+rw
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:50 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.info
Apr 10 10:37:50 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:50 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-641b8efe-8ea4-4632-96b3-f335c3f47924" returned: 0 in 0.519s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-quobyte-641b8efe-8ea4-4632-96b3-f335c3f47924" released by "delete_volume" :: held 1.117s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Created reservations ['a64e2238-a54f-46c6-8597-e60d6d874d2b', '28c3fc82-a695-40af-816a-005ef1548040', 'bf4194b5-9149-421e-83bb-22b04c23878d', '72481172-0705-4950-8d6d-9f06d8f31971'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:50 devstack sudo[87660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:37:50 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:50 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.info" returned: 0 in 0.534s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:50 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-55ad9cd0-4bf3-4f48-94e7-fcb883b447c7 tempest-VolumesDeleteCascade-285388442 None] Create snapshot completed successfully
Apr 10 10:37:50 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.451s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:37:50 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Deleted volume successfully.
Apr 10 10:37:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a31efc74-93eb-41fe-9ce2-fd5e6703a5ad tempest-CreateVolumesFromImageTest-1059521794 None] Lock "cinder-641b8efe-8ea4-4632-96b3-f335c3f47924-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Creating offline snapshot 4610ae3e-efd1-4b53-955e-b08815f98b2a of volume 010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:37:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1893e6b7-87fb-4c55-a81a-0580d04912af]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:51 devstack sudo[87663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7
Apr 10 10:37:51 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:52 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7" returned: 0 in 0.603s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:37:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:52 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a 1G
Apr 10 10:37:52 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:53 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a 1G" returned: 0 in 0.624s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:53 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a
Apr 10 10:37:53 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:53 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a" returned: 0 in 0.509s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:53 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a is being set with open permissions: ugo+rw
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:53 devstack sudo[87678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a
Apr 10 10:37:53 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (88d1718a-be00-4f44-99ca-68dea4ec71a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51f6f5a-25ea-47a7-893a-87d5ce008b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51f6f5a-25ea-47a7-893a-87d5ce008b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739851975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d260f1-4aa4-4c3c-bca9-66d29bd847cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:54Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c7b890-6fb4-4d11-ac38-2e31bc35f3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c7b890-6fb4-4d11-ac38-2e31bc35f3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca33801-2eac-4d6c-bced-9032950abb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca33801-2eac-4d6c-bced-9032950abb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d260f1-4aa4-4c3c-bca9-66d29bd847cf', 'volume_name': 'volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedd996d-8787-439c-9624-2b4686d64ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedd996d-8787-439c-9624-2b4686d64ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea53368-31fa-4a6a-a26f-bcd379b95f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:53 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume 57d260f1-4aa4-4c3c-bca9-66d29bd847cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf', 'volume_size': 1}
Apr 10 10:37:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:54 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a" returned: 0 in 0.508s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739851975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d260f1-4aa4-4c3c-bca9-66d29bd847cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:54Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Creating volume 57d260f1-4aa4-4c3c-bca9-66d29bd847cf {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:54 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:54 devstack sudo[87681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf 1073741824
Apr 10 10:37:54 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:54 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f4ef91b6-fee8-4c9f-8efe-8195fe61c9d1 tempest-VolumesDeleteCascade-285388442 None] Create snapshot completed successfully
Apr 10 10:37:54 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf 1073741824" returned: 0 in 0.581s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:54 devstack sudo[87686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf
Apr 10 10:37:54 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-010a6ebc-92f6-4d0c-a385-3a602d252b4c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-010a6ebc-92f6-4d0c-a385-3a602d252b4c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:UPDATE=205,cinder:SELECT=142,cinder:INSERT=32,cinder:DELETE=12 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=131,cinder:INSERT=57,cinder:UPDATE=167,cinder:DELETE=18 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:37:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Performing cascade delete. {{(pid=81969) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-4610ae3e-efd1-4b53-955e-b08815f98b2a-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-4610ae3e-efd1-4b53-955e-b08815f98b2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-4610ae3e-efd1-4b53-955e-b08815f98b2a" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-4610ae3e-efd1-4b53-955e-b08815f98b2a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Deleting offline snapshot 4610ae3e-efd1-4b53-955e-b08815f98b2a of volume 010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] snapshot_file for this snap is: volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a15dc-81cd-43e7-8816-c8447341498c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:55 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf" returned: 0 in 0.478s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea53368-31fa-4a6a-a26f-bcd379b95f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcb52fe-eba6-4a97-a804-09ceac60fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:55 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf (57d260f1-4aa4-4c3c-bca9-66d29bd847cf): created successfully
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcb52fe-eba6-4a97-a804-09ceac60fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (88d1718a-be00-4f44-99ca-68dea4ec71a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d8aaabdf-fb19-467e-b505-b6f6ed4b39d9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created volume successfully.
Apr 10 10:37:55 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a
Apr 10 10:37:55 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:55 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a" returned: 0 in 0.637s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1d2d6b-f522-449b-b4ac-2dbcbae654d3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:55 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7
Apr 10 10:37:55 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (8bdf6a30-c959-4609-823d-d447b2262ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f67775b-4936-4415-906c-715475ada5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f67775b-4936-4415-906c-715475ada5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962504892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40288793-7a87-4e68-aee4-93715cbd1e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:56Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cce9d84-7b42-43cd-a1dd-77de205b9038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cce9d84-7b42-43cd-a1dd-77de205b9038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4271121-d628-4cf8-8ff9-1ca66d795e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4271121-d628-4cf8-8ff9-1ca66d795e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40288793-7a87-4e68-aee4-93715cbd1e9f', 'volume_name': 'volume-40288793-7a87-4e68-aee4-93715cbd1e9f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20f20e5-5e32-47d1-810f-676e4c320bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20f20e5-5e32-47d1-810f-676e4c320bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae69c522-156f-473b-b7c6-7580463fcb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume 40288793-7a87-4e68-aee4-93715cbd1e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40288793-7a87-4e68-aee4-93715cbd1e9f', 'volume_size': 1}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962504892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40288793-7a87-4e68-aee4-93715cbd1e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:56Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Creating volume 40288793-7a87-4e68-aee4-93715cbd1e9f {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:56 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:56 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f 1073741824
Apr 10 10:37:56 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:56 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7" returned: 0 in 0.581s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:56 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a
Apr 10 10:37:56 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (f2b8ba20-e304-4cfa-b11a-4c643b50fdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8b0d16-8bd9-4cc4-acca-fede96d2e637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8b0d16-8bd9-4cc4-acca-fede96d2e637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801579219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52a5f68-79b5-4fe1-84e7-90717af25d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:56Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9d8065-fd85-4d7f-87da-31d6fdf4577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9d8065-fd85-4d7f-87da-31d6fdf4577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d75fa2a-ac2e-4090-9468-4476f078510a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d75fa2a-ac2e-4090-9468-4476f078510a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52a5f68-79b5-4fe1-84e7-90717af25d67', 'volume_name': 'volume-e52a5f68-79b5-4fe1-84e7-90717af25d67', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3301ce40-3fe9-4000-9292-759ae488840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3301ce40-3fe9-4000-9292-759ae488840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cb805c-4057-48e1-8903-11398e459398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume e52a5f68-79b5-4fe1-84e7-90717af25d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52a5f68-79b5-4fe1-84e7-90717af25d67', 'volume_size': 1}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (1c25c6e9-1fd9-41d6-8b40-78e4fc04f6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261e1262-0c7f-4f7e-a8c3-a0f6c59f26b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261e1262-0c7f-4f7e-a8c3-a0f6c59f26b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305729542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c451e088-089a-477f-a8f2-9e37b96d7a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65957bcd-e81c-41f1-a861-dee2411464ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65957bcd-e81c-41f1-a861-dee2411464ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79744279-9e57-448a-b3b2-86a863af768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79744279-9e57-448a-b3b2-86a863af768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c451e088-089a-477f-a8f2-9e37b96d7a42', 'volume_name': 'volume-c451e088-089a-477f-a8f2-9e37b96d7a42', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf00a6dc-bbf8-486f-b8d7-2c8a121a0eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf00a6dc-bbf8-486f-b8d7-2c8a121a0eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a725454-03ae-4ecf-bcd6-0a34936c3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:56 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume c451e088-089a-477f-a8f2-9e37b96d7a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c451e088-089a-477f-a8f2-9e37b96d7a42', 'volume_size': 1}
Apr 10 10:37:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:57 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a" returned: 0 in 0.710s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:57 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:57 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a
Apr 10 10:37:57 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (f2cd8224-cdc5-44f7-817c-b863533e3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6148713-e1a3-4001-a160-cb0c90cb1459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f 1073741824" returned: 0 in 0.835s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6148713-e1a3-4001-a160-cb0c90cb1459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1093378551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886e1ec5-19d7-4357-9a6b-b6a39337e761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b3f90f-3ec0-49c0-833a-b151827e4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b3f90f-3ec0-49c0-833a-b151827e4e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c05a4ac-2a1d-45ce-a824-c729802f0840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c05a4ac-2a1d-45ce-a824-c729802f0840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886e1ec5-19d7-4357-9a6b-b6a39337e761', 'volume_name': 'volume-886e1ec5-19d7-4357-9a6b-b6a39337e761', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d58b120-a02e-42fa-bc6e-87541976c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d58b120-a02e-42fa-bc6e-87541976c07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a67626-ca82-4872-a138-513fe51a5ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume 886e1ec5-19d7-4357-9a6b-b6a39337e761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886e1ec5-19d7-4357-9a6b-b6a39337e761', 'volume_size': 1}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:57 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f
Apr 10 10:37:57 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (d74230df-45df-4f29-a674-7223ce2e871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbec373-fdf1-40ec-a6bc-561c7d21ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbec373-fdf1-40ec-a6bc-561c7d21ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369427057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daab4033-b11a-47cd-844c-995994c188a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ec6f0-f1a6-4c3f-8592-7c5dfa04a471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ec6f0-f1a6-4c3f-8592-7c5dfa04a471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14096be6-f3f3-4ae4-bce6-97e3e1aa33e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14096be6-f3f3-4ae4-bce6-97e3e1aa33e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daab4033-b11a-47cd-844c-995994c188a3', 'volume_name': 'volume-daab4033-b11a-47cd-844c-995994c188a3', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a750f19-21e5-4dc5-bfdb-9f15e50ffd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a750f19-21e5-4dc5-bfdb-9f15e50ffd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcf719e-d38a-486b-8fee-7a0600136425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume daab4033-b11a-47cd-844c-995994c188a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daab4033-b11a-47cd-844c-995994c188a3', 'volume_size': 1}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:57 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.4610ae3e-efd1-4b53-955e-b08815f98b2a" returned: 0 in 0.598s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-4610ae3e-efd1-4b53-955e-b08815f98b2a" released by "_delete_snapshot" :: held 2.603s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" released by "delete_snapshot" :: held 2.621s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Created reservations ['4d965b85-d2f9-443f-9c2c-1b2159b75890', '55c577d3-3a96-437d-b235-b10fbc9d8575', 'a9b5e8a9-6b1b-4631-8dfc-276eb5e526a4', '973cf35e-9fc9-455c-819f-26c432c2075f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:37:57 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f" returned: 0 in 0.553s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801579219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52a5f68-79b5-4fe1-84e7-90717af25d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:56Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Creating volume e52a5f68-79b5-4fe1-84e7-90717af25d67 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:57 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae69c522-156f-473b-b7c6-7580463fcb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40288793-7a87-4e68-aee4-93715cbd1e9f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67 1073741824
Apr 10 10:37:57 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef61321c-9109-4180-b31e-5b0dbf46eabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:57 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume volume-40288793-7a87-4e68-aee4-93715cbd1e9f (40288793-7a87-4e68-aee4-93715cbd1e9f): created successfully
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef61321c-9109-4180-b31e-5b0dbf46eabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (8bdf6a30-c959-4609-823d-d447b2262ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-57fa12bd-7bc5-421e-b537-088a0931c40a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created volume successfully.
Apr 10 10:37:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Delete snapshot completed successfully.
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-4610ae3e-efd1-4b53-955e-b08815f98b2a-delete_snapshot" released by "delete_snapshot" :: held 2.810s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-88dd108b-fd65-4c87-9a59-922d85b340a7-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-88dd108b-fd65-4c87-9a59-922d85b340a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-88dd108b-fd65-4c87-9a59-922d85b340a7" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-88dd108b-fd65-4c87-9a59-922d85b340a7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Deleting offline snapshot 88dd108b-fd65-4c87-9a59-922d85b340a7 of volume 010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] snapshot_file for this snap is: volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6160236-6464-4e99-b158-bce72b9c93de]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:57 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7
Apr 10 10:37:57 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:58 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67 1073741824" returned: 0 in 0.600s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:58 devstack sudo[87756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67
Apr 10 10:37:58 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:58 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7" returned: 0 in 0.616s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edc5f21-8c43-492c-a8c0-6b362140b59f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:58 devstack sudo[87761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c
Apr 10 10:37:58 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:58 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67" returned: 0 in 0.500s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.122s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305729542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c451e088-089a-477f-a8f2-9e37b96d7a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Creating volume c451e088-089a-477f-a8f2-9e37b96d7a42 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:58 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cb805c-4057-48e1-8903-11398e459398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52a5f68-79b5-4fe1-84e7-90717af25d67', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:58 devstack sudo[87764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42 1073741824
Apr 10 10:37:58 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca6f35b-f8dc-4bc7-8e28-1036c46e3cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:37:58 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume volume-e52a5f68-79b5-4fe1-84e7-90717af25d67 (e52a5f68-79b5-4fe1-84e7-90717af25d67): created successfully
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca6f35b-f8dc-4bc7-8e28-1036c46e3cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:37:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (f2b8ba20-e304-4cfa-b11a-4c643b50fdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:37:58 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-88c0fd95-dc67-4af5-8628-0efeb3672334 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created volume successfully.
Apr 10 10:37:59 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c" returned: 0 in 0.520s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:59 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7
Apr 10 10:37:59 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:59 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42 1073741824" returned: 0 in 0.568s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:59 devstack sudo[87778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42
Apr 10 10:37:59 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:59 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7" returned: 0 in 0.554s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:37:59 devstack sudo[87780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7
Apr 10 10:37:59 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:37:59 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42" returned: 0 in 0.453s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.809s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1093378551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886e1ec5-19d7-4357-9a6b-b6a39337e761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Creating volume 886e1ec5-19d7-4357-9a6b-b6a39337e761 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:37:59 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:37:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a725454-03ae-4ecf-bcd6-0a34936c3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c451e088-089a-477f-a8f2-9e37b96d7a42', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3676f6ed-f3ac-4d19-bd59-72d7e7267c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:00 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761 1073741824
Apr 10 10:38:00 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:00 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume volume-c451e088-089a-477f-a8f2-9e37b96d7a42 (c451e088-089a-477f-a8f2-9e37b96d7a42): created successfully
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3676f6ed-f3ac-4d19-bd59-72d7e7267c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (1c25c6e9-1fd9-41d6-8b40-78e4fc04f6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:00 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-07b2939d-f906-434e-96e2-fa206cf10731 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created volume successfully.
Apr 10 10:38:00 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c.88dd108b-fd65-4c87-9a59-922d85b340a7" returned: 0 in 0.450s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-88dd108b-fd65-4c87-9a59-922d85b340a7" released by "_delete_snapshot" :: held 2.221s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" released by "delete_snapshot" :: held 2.235s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Created reservations ['eba6653b-acd8-4765-a188-d2c212a59b2a', 'e6dc01fb-75c6-4620-9530-5671e865247e', 'a75858ab-6691-4b6b-b91c-629d4569736d', 'bdfe72f2-8cde-4f55-9821-89926ebad42a'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:00 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Delete snapshot completed successfully.
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-88dd108b-fd65-4c87-9a59-922d85b340a7-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Snapshots deleted, issuing volume delete {{(pid=81969) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d18c2d-ceb6-4a9f-8731-6f9d7e7e145f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:00 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c
Apr 10 10:38:00 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:00 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761 1073741824" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:00 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761
Apr 10 10:38:00 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:00 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c" returned: 0 in 0.591s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:00 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c
Apr 10 10:38:00 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:00 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761" returned: 0 in 0.417s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.597s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369427057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daab4033-b11a-47cd-844c-995994c188a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e00e6a26a084ff0a82529146d00d437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='fbaa7cdafbab49419530f1e814a2278e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Creating volume daab4033-b11a-47cd-844c-995994c188a3 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:01 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a67626-ca82-4872-a138-513fe51a5ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886e1ec5-19d7-4357-9a6b-b6a39337e761', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c6908-888b-4fb7-b2e4-578ee3536e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:01 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3 1073741824
Apr 10 10:38:01 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:01 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume volume-886e1ec5-19d7-4357-9a6b-b6a39337e761 (886e1ec5-19d7-4357-9a6b-b6a39337e761): created successfully
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c6908-888b-4fb7-b2e4-578ee3536e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (f2cd8224-cdc5-44f7-817c-b863533e3b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:01 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c5d34bfb-d3c6-4938-b392-7573b81b619b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created volume successfully.
Apr 10 10:38:01 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-010a6ebc-92f6-4d0c-a385-3a602d252b4c" returned: 0 in 0.409s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-010a6ebc-92f6-4d0c-a385-3a602d252b4c" released by "delete_volume" :: held 1.035s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Created reservations ['e64bdda2-f899-4e64-95e7-edc99ee4b595', 'b8d12a71-6df4-41f0-956b-3f831e1d7b62', 'fd80ffaf-3b60-44ba-baab-0ba413cc7f52', '30969f5f-f88d-4e27-9afd-d6e149321c72'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:01 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:01 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:01 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3 1073741824" returned: 0 in 0.640s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:01 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3
Apr 10 10:38:01 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:01 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.527s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:01 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Deleted volume successfully.
Apr 10 10:38:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f5afecb7-b6f8-4670-97dd-49cf7dfe58db tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-010a6ebc-92f6-4d0c-a385-3a602d252b4c-delete_volume" released by "delete_volume" :: held 6.980s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:02 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3" returned: 0 in 0.458s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcf719e-d38a-486b-8fee-7a0600136425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daab4033-b11a-47cd-844c-995994c188a3', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86e5cba-ea60-4669-b5b9-96ed824e7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:02 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Volume volume-daab4033-b11a-47cd-844c-995994c188a3 (daab4033-b11a-47cd-844c-995994c188a3): created successfully
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86e5cba-ea60-4669-b5b9-96ed824e7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Flow 'volume_create_manager' (d74230df-45df-4f29-a674-7223ce2e871d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:02 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3deb4732-21a7-4b3f-913f-5cf54297e38b tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created volume successfully.
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Flow 'volume_create_manager' (6bb84472-ade6-422f-9430-c93df6e43507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad81ecdf-5eff-42f9-9ca3-82ea49df0c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad81ecdf-5eff-42f9-9ca3-82ea49df0c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1244662558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72bf6e7-e31c-49c7-b6e4-7ae760e356aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fdcd15eda446428597e6f93373af63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:03Z,use_quota=True,user_id='b8975d618d2a4ecaa07be37b90c337d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0548e9f-6df5-4eb8-b973-fcf7089d33b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0548e9f-6df5-4eb8-b973-fcf7089d33b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bd74f7-e9ce-4cd0-a736-6f8543d3cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bd74f7-e9ce-4cd0-a736-6f8543d3cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72bf6e7-e31c-49c7-b6e4-7ae760e356aa', 'volume_name': 'volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee43e9c0-289b-44fe-9f96-b164ca136f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee43e9c0-289b-44fe-9f96-b164ca136f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaff859c-66fd-478c-b403-bc80a9bab078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:02 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Volume b72bf6e7-e31c-49c7-b6e4-7ae760e356aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa', 'volume_size': 1}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1244662558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72bf6e7-e31c-49c7-b6e4-7ae760e356aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fdcd15eda446428597e6f93373af63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:03Z,use_quota=True,user_id='b8975d618d2a4ecaa07be37b90c337d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Creating volume b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:02 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-daab4033-b11a-47cd-844c-995994c188a3-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:02 devstack sudo[87811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa 1073741824
Apr 10 10:38:02 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-daab4033-b11a-47cd-844c-995994c188a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-quobyte-daab4033-b11a-47cd-844c-995994c188a3" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-daab4033-b11a-47cd-844c-995994c188a3" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[95539595-632e-4427-8e1f-d2be35eff441]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:03 devstack sudo[87813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3
Apr 10 10:38:03 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:03 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa 1073741824" returned: 0 in 0.603s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:03 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa
Apr 10 10:38:03 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:03 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3" returned: 0 in 0.673s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:03 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3
Apr 10 10:38:03 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:04 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" returned: 0 in 0.497s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaff859c-66fd-478c-b403-bc80a9bab078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe043ef-3221-4831-9048-8de3ec0612bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:04 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Volume volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa (b72bf6e7-e31c-49c7-b6e4-7ae760e356aa): created successfully
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe043ef-3221-4831-9048-8de3ec0612bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Flow 'volume_create_manager' (6bb84472-ade6-422f-9430-c93df6e43507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:04 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d2fca4a8-215e-4e61-a06a-7207820172ab tempest-VolumesDeleteCascade-285388442 None] Created volume successfully.
Apr 10 10:38:04 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-daab4033-b11a-47cd-844c-995994c188a3" returned: 0 in 0.596s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-daab4033-b11a-47cd-844c-995994c188a3" released by "delete_volume" :: held 1.296s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created reservations ['3530ad4e-6f40-44c7-ba57-d117e2968db1', 'b5ac5bf8-c8b5-459d-8c69-39fd62af2beb', '122274bf-654b-4d3f-a98b-c63b37e5d1d1', '4699e2a7-dcc5-425b-81cb-5bc4446e6d9d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:04 devstack sudo[87827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:04 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:04 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.431s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:04 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Deleted volume successfully.
Apr 10 10:38:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-52a1451e-a3be-4c04-886f-690d2464bad9 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-daab4033-b11a-47cd-844c-995994c188a3-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-886e1ec5-19d7-4357-9a6b-b6a39337e761-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-886e1ec5-19d7-4357-9a6b-b6a39337e761-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Creating offline snapshot 820a45ac-7952-455e-a174-de8a2fceaac1 of volume b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21b15df-2168-470f-82e7-f1ae4bcb8bc5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-quobyte-886e1ec5-19d7-4357-9a6b-b6a39337e761" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-886e1ec5-19d7-4357-9a6b-b6a39337e761" acquired by "delete_volume" :: waited 0.024s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df3dcd-e158-4cd8-85e6-2720abf3a40a]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:05 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa
Apr 10 10:38:05 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:05 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761
Apr 10 10:38:05 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:05 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761" returned: 0 in 0.481s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:05 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761
Apr 10 10:38:05 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:05 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" returned: 0 in 0.553s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:05 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 1G
Apr 10 10:38:05 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:06 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-886e1ec5-19d7-4357-9a6b-b6a39337e761" returned: 0 in 0.409s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-886e1ec5-19d7-4357-9a6b-b6a39337e761" released by "delete_volume" :: held 0.915s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created reservations ['f48e66b2-730d-4508-923b-b965e49058b2', 'cbb79428-88ac-41be-8867-ca664769e65d', 'cc47dfe5-e582-4b5d-862e-8d32a38f8aaa', '5a06e2ff-546f-439f-8915-9d62c32da534'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:06 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:06 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-c451e088-089a-477f-a8f2-9e37b96d7a42-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-c451e088-089a-477f-a8f2-9e37b96d7a42-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:06 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-quobyte-c451e088-089a-477f-a8f2-9e37b96d7a42" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 1G" returned: 0 in 0.595s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-c451e088-089a-477f-a8f2-9e37b96d7a42" acquired by "delete_volume" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:06 devstack sudo[87851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ff3ee4-e11a-49ac-a89f-2270defd2fa6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:06 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:06 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42
Apr 10 10:38:06 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:06 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.506s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:06 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Deleted volume successfully.
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa0dfb61-d7e2-4916-bafb-9a8672ecf174 tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-886e1ec5-19d7-4357-9a6b-b6a39337e761-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:06 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1" returned: 0 in 0.495s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:06 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 is being set with open permissions: ugo+rw
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:06 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1
Apr 10 10:38:06 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:06 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42" returned: 0 in 0.534s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:06 devstack sudo[87864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42
Apr 10 10:38:06 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:07 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1" returned: 0 in 0.426s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:07 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.info
Apr 10 10:38:07 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:07 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c451e088-089a-477f-a8f2-9e37b96d7a42" returned: 0 in 0.435s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-c451e088-089a-477f-a8f2-9e37b96d7a42" released by "delete_volume" :: held 0.994s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created reservations ['1bca60da-48c7-4a86-9e5a-7fab527ec340', 'd0e40880-8dac-40d1-86ca-5c045090b443', '3356f12b-0ca4-4a64-a269-fdfd388dcee7', 'a3e17a99-d7aa-4501-bd15-25c4151bab9d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:07 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:07 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:07 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.info" returned: 0 in 0.480s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:07 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.info is being set with open permissions: ugo+rw
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:07 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.info
Apr 10 10:38:07 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:07 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.444s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:07 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Deleted volume successfully.
Apr 10 10:38:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0cf19f63-8f11-4b27-8c34-137b5130669c tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-c451e088-089a-477f-a8f2-9e37b96d7a42-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:08 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.info" returned: 0 in 0.431s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:08 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-6a0df9c6-83b2-42db-9cd7-64d3a91f2754 tempest-VolumesDeleteCascade-285388442 None] Create snapshot completed successfully
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-e52a5f68-79b5-4fe1-84e7-90717af25d67-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-e52a5f68-79b5-4fe1-84e7-90717af25d67-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-quobyte-e52a5f68-79b5-4fe1-84e7-90717af25d67" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-e52a5f68-79b5-4fe1-84e7-90717af25d67" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e13b61-e7c6-4220-8ec4-97f4397db8fd]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:08 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67
Apr 10 10:38:08 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:08 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67" returned: 0 in 0.479s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:08 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67
Apr 10 10:38:08 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:09 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e52a5f68-79b5-4fe1-84e7-90717af25d67" returned: 0 in 0.451s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-e52a5f68-79b5-4fe1-84e7-90717af25d67" released by "delete_volume" :: held 0.955s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created reservations ['3c663146-e96f-4838-9132-b3eb506e0fc3', '9f656737-4f96-448c-b245-a5b7068a4905', 'c91a8564-f15f-40ea-b405-c2f3aaf338dd', '6e3c3bb9-2d8c-426c-b1c0-9e877fa3f734'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:09 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:09 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-40288793-7a87-4e68-aee4-93715cbd1e9f-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-40288793-7a87-4e68-aee4-93715cbd1e9f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Flow 'volume_create_manager' (cded9594-949f-4abe-aeaa-135e6f517431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ffe3b-c806-43e0-bade-425d20e5627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ffe3b-c806-43e0-bade-425d20e5627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2104555283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74569298-e16f-4d4b-8f03-71283ca9ca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fdcd15eda446428597e6f93373af63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=820a45ac-7952-455e-a174-de8a2fceaac1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:10Z,use_quota=True,user_id='b8975d618d2a4ecaa07be37b90c337d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb8d6d2-0cae-4620-8c79-46b326175b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb8d6d2-0cae-4620-8c79-46b326175b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7666cde6-a4c6-4cd7-aec3-8cabfa3898ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7666cde6-a4c6-4cd7-aec3-8cabfa3898ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74569298-e16f-4d4b-8f03-71283ca9ca01', 'volume_name': 'volume-74569298-e16f-4d4b-8f03-71283ca9ca01', 'volume_size': 1, 'snapshot_id': '820a45ac-7952-455e-a174-de8a2fceaac1'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62aa951-c501-45d8-b8ec-6d22f2a3b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62aa951-c501-45d8-b8ec-6d22f2a3b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52926917-8f28-4d27-a7b7-0d753a0e581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:09 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Volume 74569298-e16f-4d4b-8f03-71283ca9ca01: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74569298-e16f-4d4b-8f03-71283ca9ca01', 'volume_size': 1, 'snapshot_id': '820a45ac-7952-455e-a174-de8a2fceaac1'}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-820a45ac-7952-455e-a174-de8a2fceaac1-74569298-e16f-4d4b-8f03-71283ca9ca01" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-quobyte-40288793-7a87-4e68-aee4-93715cbd1e9f" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-820a45ac-7952-455e-a174-de8a2fceaac1-74569298-e16f-4d4b-8f03-71283ca9ca01" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Creating volume 74569298-e16f-4d4b-8f03-71283ca9ca01 from snapshot 820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-74569298-e16f-4d4b-8f03-71283ca9ca01" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-40288793-7a87-4e68-aee4-93715cbd1e9f" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-74569298-e16f-4d4b-8f03-71283ca9ca01" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] snapshot: 820a45ac-7952-455e-a174-de8a2fceaac1, volume: 74569298-e16f-4d4b-8f03-71283ca9ca01,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[342664be-a889-47e7-883d-997905ad6706]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[26717e8e-3bfd-4037-af32-a8641beb6bd5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:09 devstack sudo[87888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f
Apr 10 10:38:09 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:09 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1
Apr 10 10:38:09 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:10 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.483s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:10 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Deleted volume successfully.
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7fb11654-b87b-4835-bad3-e3dc34e6750f tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-e52a5f68-79b5-4fe1-84e7-90717af25d67-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:10 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:10 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f
Apr 10 10:38:10 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:10 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1" returned: 0 in 0.511s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e55136f-85ab-4b6a-9cef-8786cd5e56b1]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:10 devstack sudo[87901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa
Apr 10 10:38:10 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:10 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-40288793-7a87-4e68-aee4-93715cbd1e9f" returned: 0 in 0.456s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-40288793-7a87-4e68-aee4-93715cbd1e9f" released by "delete_volume" :: held 0.989s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created reservations ['4b58751e-ab60-463d-b5a2-d4065ca33090', '9a18b8dc-0685-4b0c-8164-d56cc4a6d5c8', 'c153c94e-7bd7-43df-a332-ad012f997d4b', '2f24cb18-7486-4d2b-80f6-b9da10be3ed7'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:10 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" returned: 0 in 0.531s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:38:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:10 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:10 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:10 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01
Apr 10 10:38:10 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:11 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.448s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:11 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:11 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Deleted volume successfully.
Apr 10 10:38:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-697a8e4f-1604-4b11-a087-1c5f5d1af89a tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-40288793-7a87-4e68-aee4-93715cbd1e9f-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-57d260f1-4aa4-4c3c-bca9-66d29bd847cf-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-57d260f1-4aa4-4c3c-bca9-66d29bd847cf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "cinder-quobyte-57d260f1-4aa4-4c3c-bca9-66d29bd847cf" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-57d260f1-4aa4-4c3c-bca9-66d29bd847cf" acquired by "delete_volume" :: waited 0.024s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:12 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f20e0-7f82-424d-97a2-0e58c6372d29]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:12 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf
Apr 10 10:38:12 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:13 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01" returned: 0 in 2.562s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:13 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[04607cbf-12e1-4fd8-97d9-db51508709d8]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:13 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa
Apr 10 10:38:13 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:13 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf" returned: 0 in 1.469s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:13 devstack sudo[87929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf
Apr 10 10:38:13 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:13 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-57d260f1-4aa4-4c3c-bca9-66d29bd847cf" returned: 0 in 0.459s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-quobyte-57d260f1-4aa4-4c3c-bca9-66d29bd847cf" released by "delete_volume" :: held 1.973s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Created reservations ['de10a18b-10cf-4256-9c00-0de5861bfede', 'bdfea391-9055-4afa-ad8c-8709f0f1a019', 'ab46e05f-23b4-4605-9261-747dbcf52aba', '9bab8cc1-c55f-4a0a-947a-ffafd2a3d994'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:14 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:14 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:14 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" returned: 0 in 0.711s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:38:14 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Converted 1024.00 MB image at 399.33 MB/s
Apr 10 10:38:14 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01 is being set with open permissions: ugo+rw
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:14 devstack sudo[87937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01
Apr 10 10:38:14 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:14 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.557s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:14 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Deleted volume successfully.
Apr 10 10:38:14 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01" returned: 0 in 0.540s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-48a607dc-edc1-4788-b3a9-226b8f2d0d9e tempest-CreateVolumesFromSourceVolumeTest-1922343610 None] Lock "cinder-57d260f1-4aa4-4c3c-bca9-66d29bd847cf-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-74569298-e16f-4d4b-8f03-71283ca9ca01" released by "_copy_volume_from_snapshot" :: held 4.927s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-820a45ac-7952-455e-a174-de8a2fceaac1-74569298-e16f-4d4b-8f03-71283ca9ca01" released by "_create_volume_from_snapshot" :: held 4.953s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.973s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52926917-8f28-4d27-a7b7-0d753a0e581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74569298-e16f-4d4b-8f03-71283ca9ca01', 'volume_size': 1, 'snapshot_id': '820a45ac-7952-455e-a174-de8a2fceaac1'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ceea6e-4fa3-41f9-9ae4-1cbf5bac2f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:14 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Volume volume-74569298-e16f-4d4b-8f03-71283ca9ca01 (74569298-e16f-4d4b-8f03-71283ca9ca01): created successfully
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ceea6e-4fa3-41f9-9ae4-1cbf5bac2f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:14 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Flow 'volume_create_manager' (cded9594-949f-4abe-aeaa-135e6f517431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:14 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-553aefcd-facb-4125-9f13-d0af562ac345 tempest-VolumesDeleteCascade-285388442 None] Created volume successfully.
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Performing cascade delete. {{(pid=81969) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-820a45ac-7952-455e-a174-de8a2fceaac1-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-820a45ac-7952-455e-a174-de8a2fceaac1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-820a45ac-7952-455e-a174-de8a2fceaac1" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-820a45ac-7952-455e-a174-de8a2fceaac1" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Deleting offline snapshot 820a45ac-7952-455e-a174-de8a2fceaac1 of volume b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] snapshot_file for this snap is: volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d4a87-1cdb-436e-8eac-51a168c9952b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:15 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1
Apr 10 10:38:15 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:15 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1" returned: 0 in 0.602s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b0f63a-cb4e-4903-826a-c0281cca72f0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:15 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa
Apr 10 10:38:15 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (a3c47d0b-1e69-470c-874b-4c727703562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504ea4ff-6460-4688-95d1-d1f4063c9036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:16 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504ea4ff-6460-4688-95d1-d1f4063c9036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-804049848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9105cf-5669-4954-9f84-3f70bd235a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6169106b76549ae954e547eb633fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:16Z,use_quota=True,user_id='6fa919730b7b47b6bac10f419520edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72525c8-f6c7-4671-ab19-05e61b644cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72525c8-f6c7-4671-ab19-05e61b644cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11524a5-4a9c-44b6-85da-34891f66850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11524a5-4a9c-44b6-85da-34891f66850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9105cf-5669-4954-9f84-3f70bd235a4b', 'volume_name': 'volume-2e9105cf-5669-4954-9f84-3f70bd235a4b', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f9a208-27f3-4940-9b63-b025ad28439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f9a208-27f3-4940-9b63-b025ad28439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf017b1-368e-4ef5-ac8e-5ec5ce531fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:16 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Volume 2e9105cf-5669-4954-9f84-3f70bd235a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9105cf-5669-4954-9f84-3f70bd235a4b', 'volume_size': 1}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-804049848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9105cf-5669-4954-9f84-3f70bd235a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6169106b76549ae954e547eb633fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:16Z,use_quota=True,user_id='6fa919730b7b47b6bac10f419520edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Creating volume 2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:16 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" returned: 0 in 0.679s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:16 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b 1073741824
Apr 10 10:38:16 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:16 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1
Apr 10 10:38:16 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:17 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1" returned: 0 in 0.556s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:17 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b 1073741824" returned: 0 in 0.585s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:17 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1
Apr 10 10:38:17 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:17 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b
Apr 10 10:38:17 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:17 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa.820a45ac-7952-455e-a174-de8a2fceaac1" returned: 0 in 0.515s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-820a45ac-7952-455e-a174-de8a2fceaac1" released by "_delete_snapshot" :: held 2.425s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" released by "delete_snapshot" :: held 2.442s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:17 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b" returned: 0 in 0.520s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf017b1-368e-4ef5-ac8e-5ec5ce531fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9105cf-5669-4954-9f84-3f70bd235a4b', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2d4047-8381-43d0-a813-c77c8f2c8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Volume volume-2e9105cf-5669-4954-9f84-3f70bd235a4b (2e9105cf-5669-4954-9f84-3f70bd235a4b): created successfully
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2d4047-8381-43d0-a813-c77c8f2c8619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (a3c47d0b-1e69-470c-874b-4c727703562d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:17 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-32d0b86b-50cc-45ff-b5c8-ad2b82995ecc tempest-VolumeDependencyTests-1591837227 None] Created volume successfully.
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Created reservations ['8855b4e7-d030-4408-9867-fd8a5982c640', 'c0a8d121-6e1d-4f29-8bc4-c99c0e09e7cf', 'c41aa702-f086-4926-9502-f4927edf4d53', '8fac2dbd-c11c-43a6-a414-65a33d4be87a'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:17 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Delete snapshot completed successfully.
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-820a45ac-7952-455e-a174-de8a2fceaac1-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Snapshots deleted, issuing volume delete {{(pid=81969) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430330d-637c-4996-bf09-fa785e89b2ef]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:17 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa
Apr 10 10:38:17 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:18 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" returned: 0 in 0.551s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:18 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa
Apr 10 10:38:18 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Creating offline snapshot cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 of volume 2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3d5777-206b-4a63-817b-6bc588dd4faa]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:18 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b
Apr 10 10:38:18 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:18 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" returned: 0 in 0.525s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa" released by "delete_volume" :: held 1.110s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Created reservations ['d9fcad9f-7fa8-4761-8cdd-f7d8c2dfcff8', '93d0ee9d-9bfc-412c-ac7a-70936241e5f6', 'c2d96751-56e4-49ed-b41b-1cb0e7a6fb80', 'ce6d7606-7282-4e1e-b012-2f61ee559233'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:18 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:18 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:19 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b" returned: 0 in 0.532s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:19 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 1G
Apr 10 10:38:19 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:19 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.508s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Deleted volume successfully.
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c555278b-fb8d-4209-a476-27423a1904a1 tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-b72bf6e7-e31c-49c7-b6e4-7ae760e356aa-delete_volume" released by "delete_volume" :: held 4.401s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-74569298-e16f-4d4b-8f03-71283ca9ca01-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-74569298-e16f-4d4b-8f03-71283ca9ca01-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "cinder-quobyte-74569298-e16f-4d4b-8f03-71283ca9ca01" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-74569298-e16f-4d4b-8f03-71283ca9ca01" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f89594-81b9-4d2c-bdb3-6768ab140a32]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:19 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01
Apr 10 10:38:19 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:19 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 1G" returned: 0 in 0.591s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9105cf-5669-4954-9f84-3f70bd235a4b -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:19 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9105cf-5669-4954-9f84-3f70bd235a4b -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62
Apr 10 10:38:19 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:20 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01" returned: 0 in 0.565s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:20 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01
Apr 10 10:38:20 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:20 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9105cf-5669-4954-9f84-3f70bd235a4b -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" returned: 0 in 0.508s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:20 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 is being set with open permissions: ugo+rw
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:20 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62
Apr 10 10:38:20 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:20 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-74569298-e16f-4d4b-8f03-71283ca9ca01" returned: 0 in 0.474s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-quobyte-74569298-e16f-4d4b-8f03-71283ca9ca01" released by "delete_volume" :: held 1.069s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Created reservations ['bc4d3734-9eb0-4577-bc90-fe5207b1af42', '87a36732-bde6-4955-8e2f-6c21d4de1ab3', 'fb3cab6f-b14a-4f58-9b96-d322d53397ae', 'aa5680c6-ed5b-4850-a7b5-b31d93cbb91f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:20 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:20 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:20 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" returned: 0 in 0.472s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:20 devstack sudo[88007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.info
Apr 10 10:38:20 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:21 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.444s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:21 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Deleted volume successfully.
Apr 10 10:38:21 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-c4f5aad8-81b8-4269-b93d-18f2ec4c3dfc tempest-VolumesDeleteCascade-285388442 None] Lock "cinder-74569298-e16f-4d4b-8f03-71283ca9ca01-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:21 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.info" returned: 0 in 0.459s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:21 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.info is being set with open permissions: ugo+rw
Apr 10 10:38:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:21 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.info
Apr 10 10:38:21 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:21 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.info" returned: 0 in 0.452s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.082s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ac846310-6b84-4052-90da-e515218b4eb2 tempest-VolumeDependencyTests-1591837227 None] Create snapshot completed successfully
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (7b89a233-2cf6-49e9-abf8-c2dea9d72185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a01faa-a064-4712-a948-5eabca8e9dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a01faa-a064-4712-a948-5eabca8e9dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-976748216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdf7214-fd24-4c9a-9d67-67a45ddbdf67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6169106b76549ae954e547eb633fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb17c1fd-29be-42b5-b3c4-65c30dbdaa62,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:23Z,use_quota=True,user_id='6fa919730b7b47b6bac10f419520edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f434c06f-965e-44a5-a66c-f5cb08011f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f434c06f-965e-44a5-a66c-f5cb08011f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d784f8c5-c750-434e-9653-61d9d6c874e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d784f8c5-c750-434e-9653-61d9d6c874e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cdf7214-fd24-4c9a-9d67-67a45ddbdf67', 'volume_name': 'volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67', 'volume_size': 1, 'snapshot_id': 'cb17c1fd-29be-42b5-b3c4-65c30dbdaa62'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af6a960-9f07-4fd9-9711-1dcb72606671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af6a960-9f07-4fd9-9711-1dcb72606671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8c0be5-f302-4229-80ce-08712785705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Volume 3cdf7214-fd24-4c9a-9d67-67a45ddbdf67: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67', 'volume_size': 1, 'snapshot_id': 'cb17c1fd-29be-42b5-b3c4-65c30dbdaa62'}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Creating volume 3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 from snapshot cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] snapshot: cb17c1fd-29be-42b5-b3c4-65c30dbdaa62, volume: 3cdf7214-fd24-4c9a-9d67-67a45ddbdf67,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315308b-832f-4638-b20b-4f2bb6effa13]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:23 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62
Apr 10 10:38:23 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Flow 'volume_create_manager' (1c44fc56-9c05-4ba4-81b8-d3c171e31af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83adef65-9bb1-4b18-9aee-23f46716416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83adef65-9bb1-4b18-9aee-23f46716416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-151444269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c889f01c-f87b-4f77-b2b4-1ade9d46404a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c3a0d0a9e404e93322510f8050de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:24Z,use_quota=True,user_id='473e0a57fdb2490cb7447c6cd14d8f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a43cc5e-52b9-4175-a015-4e0d2b4d211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a43cc5e-52b9-4175-a015-4e0d2b4d211f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe485ca-66a1-4cf3-b85d-892aa1aedfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe485ca-66a1-4cf3-b85d-892aa1aedfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c889f01c-f87b-4f77-b2b4-1ade9d46404a', 'volume_name': 'volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efb6696-0f49-449a-9a47-052af4dfa453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efb6696-0f49-449a-9a47-052af4dfa453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37576fa1-7991-4fdd-aea6-f40313be5766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:23 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Volume c889f01c-f87b-4f77-b2b4-1ade9d46404a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a', 'volume_size': 1}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" returned: 0 in 0.585s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e9105cf-5669-4954-9f84-3f70bd235a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:38:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:38:24 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80b1c1e-88ed-4d23-ae34-107a88d22f4e]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:24 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b
Apr 10 10:38:24 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:24 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b" returned: 0 in 0.524s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:24 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:38:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:24 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67
Apr 10 10:38:24 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:27 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" returned: 0 in 2.473s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:27 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b6b1a8-227f-4361-9700-ea7e000cbc6f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:27 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b
Apr 10 10:38:27 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:27 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b" returned: 0 in 0.653s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:27 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:38:27 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Converted 1024.00 MB image at 413.74 MB/s
Apr 10 10:38:27 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 is being set with open permissions: ugo+rw
Apr 10 10:38:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:27 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67
Apr 10 10:38:27 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:28 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" returned: 0 in 0.499s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" released by "_copy_volume_from_snapshot" :: held 4.804s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" released by "_create_volume_from_snapshot" :: held 4.830s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.845s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.192s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-151444269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c889f01c-f87b-4f77-b2b4-1ade9d46404a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c3a0d0a9e404e93322510f8050de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:24Z,use_quota=True,user_id='473e0a57fdb2490cb7447c6cd14d8f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Creating volume c889f01c-f87b-4f77-b2b4-1ade9d46404a {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:28 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:28 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a 1073741824
Apr 10 10:38:28 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8c0be5-f302-4229-80ce-08712785705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67', 'volume_size': 1, 'snapshot_id': 'cb17c1fd-29be-42b5-b3c4-65c30dbdaa62'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4015c9-23f1-4304-bc91-c0e080110ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:28 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Volume volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 (3cdf7214-fd24-4c9a-9d67-67a45ddbdf67): created successfully
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4015c9-23f1-4304-bc91-c0e080110ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (7b89a233-2cf6-49e9-abf8-c2dea9d72185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d37eaa24-a6cd-4551-8be8-64a38c029e61 tempest-VolumeDependencyTests-1591837227 None] Created volume successfully.
Apr 10 10:38:28 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a 1073741824" returned: 0 in 0.514s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:28 devstack sudo[88052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a
Apr 10 10:38:28 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-2e9105cf-5669-4954-9f84-3f70bd235a4b" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-2e9105cf-5669-4954-9f84-3f70bd235a4b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Deleting offline snapshot cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 of volume 2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] snapshot_file for this snap is: volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[699e6ab6-075f-4a1f-8b10-f2bc78551088]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:29 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62
Apr 10 10:38:29 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:29 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a" returned: 0 in 0.476s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37576fa1-7991-4fdd-aea6-f40313be5766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30b0904-f910-49fc-ad45-86abb727adaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:29 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Volume volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a (c889f01c-f87b-4f77-b2b4-1ade9d46404a): created successfully
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30b0904-f910-49fc-ad45-86abb727adaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Flow 'volume_create_manager' (1c44fc56-9c05-4ba4-81b8-d3c171e31af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ebc8b6b6-4eb8-46e6-9ab9-e68cfe65ae7c tempest-VolumesMetadataTest-1995781503 None] Created volume successfully.
Apr 10 10:38:29 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" returned: 0 in 0.518s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e9105cf-5669-4954-9f84-3f70bd235a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf2b5e-08ff-4c82-8c63-1c9ce5dc3b46]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:29 devstack sudo[88061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b
Apr 10 10:38:29 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:29 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b" returned: 0 in 0.474s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:29 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62
Apr 10 10:38:29 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:30 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" returned: 0 in 0.489s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:30 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62
Apr 10 10:38:30 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Acquiring lock "cinder-c889f01c-f87b-4f77-b2b4-1ade9d46404a-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Lock "cinder-c889f01c-f87b-4f77-b2b4-1ade9d46404a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:30 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Acquiring lock "cinder-quobyte-c889f01c-f87b-4f77-b2b4-1ade9d46404a" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b.cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" returned: 0 in 0.516s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Lock "cinder-quobyte-c889f01c-f87b-4f77-b2b4-1ade9d46404a" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3662e29-8418-4aa2-9c22-646fdd4d8d3c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62" released by "_delete_snapshot" :: held 2.103s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-2e9105cf-5669-4954-9f84-3f70bd235a4b" released by "delete_snapshot" :: held 2.118s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Created reservations ['ae225446-68ef-4f65-838e-fa1ab6a5a2f3', '093c41c3-eb10-458f-b3f8-5c711fbb79dc', 'f698d16b-17bf-443d-a79b-3d2b74deaff1', '857f0b2e-f064-42f8-ab72-f31339d6381e'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:31 devstack sudo[88074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a
Apr 10 10:38:31 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Delete snapshot completed successfully.
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e36dcc7a-3946-4543-a78d-0c2739c039cd tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-cb17c1fd-29be-42b5-b3c4-65c30dbdaa62-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:31 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a" returned: 0 in 0.506s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:31 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a
Apr 10 10:38:31 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:31 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c889f01c-f87b-4f77-b2b4-1ade9d46404a" returned: 0 in 0.407s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Lock "cinder-quobyte-c889f01c-f87b-4f77-b2b4-1ade9d46404a" released by "delete_volume" :: held 0.960s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:31 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Created reservations ['9d9e5800-db0e-4d56-a44d-b78a0c3e01fa', '201da1c6-2331-4811-be32-77db4d2e7110', '470bb499-8a62-4777-8266-18f941e71823', '8e978889-a743-4eec-9dc2-b288116ae8a9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:32 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:32 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-2e9105cf-5669-4954-9f84-3f70bd235a4b-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-2e9105cf-5669-4954-9f84-3f70bd235a4b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-2e9105cf-5669-4954-9f84-3f70bd235a4b" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-2e9105cf-5669-4954-9f84-3f70bd235a4b" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab63a7-9081-427f-8764-1cf868a6eb54]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:32 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b
Apr 10 10:38:32 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:32 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.549s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:32 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Deleted volume successfully.
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-afddebf0-46a1-471a-abbf-9675186f05ac tempest-VolumesMetadataTest-1995781503 None] Lock "cinder-c889f01c-f87b-4f77-b2b4-1ade9d46404a-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:32 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b" returned: 0 in 0.679s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:32 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b
Apr 10 10:38:32 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:33 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-2e9105cf-5669-4954-9f84-3f70bd235a4b" returned: 0 in 0.619s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-2e9105cf-5669-4954-9f84-3f70bd235a4b" released by "delete_volume" :: held 1.335s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Created reservations ['28dc2fe4-afb7-4c2d-826d-8715f24a3df7', '76109f28-5dca-4589-8bf7-029c9cc0e45c', '65d7e3f7-901a-4efe-bb5c-37624379e383', 'af39f01b-e106-407d-bb36-2cedce50bdb8'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:33 devstack sudo[88093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:33 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:34 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.643s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:34 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Deleted volume successfully.
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-054d8e27-8f60-4781-a59b-ba8aecb71c37 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-2e9105cf-5669-4954-9f84-3f70bd235a4b-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Flow 'volume_create_manager' (a5d4415e-f8d9-446f-80d7-792a4eef8141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba488e13-ae29-4e36-972a-f9b7c4164eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba488e13-ae29-4e36-972a-f9b7c4164eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-920559665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c05d72-f254-479f-a058-b3250c771f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb88b6fb086f4b6799a2d83040f58197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:34Z,use_quota=True,user_id='bd71b479550344719eeadff5e87c4299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d385815-75f1-4b81-a969-6d0c1add18f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d385815-75f1-4b81-a969-6d0c1add18f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a67c15-1da8-40db-87da-9a298330c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a67c15-1da8-40db-87da-9a298330c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c05d72-f254-479f-a058-b3250c771f53', 'volume_name': 'volume-51c05d72-f254-479f-a058-b3250c771f53', 'volume_size': 2}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a687524e-5fc2-48ec-af9c-8f3cd1238a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a687524e-5fc2-48ec-af9c-8f3cd1238a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2b1034-029d-4799-82f0-48ca715e2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Volume 51c05d72-f254-479f-a058-b3250c771f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c05d72-f254-479f-a058-b3250c771f53', 'volume_size': 2}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-920559665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c05d72-f254-479f-a058-b3250c771f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb88b6fb086f4b6799a2d83040f58197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:34Z,use_quota=True,user_id='bd71b479550344719eeadff5e87c4299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Creating volume 51c05d72-f254-479f-a058-b3250c771f53 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:34 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53 2147483648 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:34 devstack sudo[88096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53 2147483648
Apr 10 10:38:34 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (55182d19-ed58-4814-841a-c80aff7fc25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4caa08f0-ef60-49b2-97b3-f0cfef1b0a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4caa08f0-ef60-49b2-97b3-f0cfef1b0a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-645087281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001e0800-a014-49e8-8933-5c65f70e2d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6169106b76549ae954e547eb633fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:35Z,use_quota=True,user_id='6fa919730b7b47b6bac10f419520edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6e8219-4687-4ea1-88e8-a70e43870a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6e8219-4687-4ea1-88e8-a70e43870a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b4676c-e30e-4a3e-a173-7a12d7ac0c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b4676c-e30e-4a3e-a173-7a12d7ac0c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001e0800-a014-49e8-8933-5c65f70e2d74', 'volume_name': 'volume-001e0800-a014-49e8-8933-5c65f70e2d74', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25c1916-7c7c-4972-add9-7964700b1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25c1916-7c7c-4972-add9-7964700b1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586b95e4-4d13-447b-8015-c1bb6282908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:34 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Volume 001e0800-a014-49e8-8933-5c65f70e2d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001e0800-a014-49e8-8933-5c65f70e2d74', 'volume_size': 1}
Apr 10 10:38:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:35 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53 2147483648" returned: 0 in 0.602s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:35 devstack sudo[88101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53
Apr 10 10:38:35 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:35 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53" returned: 0 in 0.450s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.801s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-645087281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001e0800-a014-49e8-8933-5c65f70e2d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6169106b76549ae954e547eb633fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:35Z,use_quota=True,user_id='6fa919730b7b47b6bac10f419520edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Creating volume 001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:35 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2b1034-029d-4799-82f0-48ca715e2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c05d72-f254-479f-a058-b3250c771f53', 'volume_size': 2}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ae3240-7bf0-45f8-8082-07cb8a671725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:35 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 1073741824
Apr 10 10:38:35 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:35 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Volume volume-51c05d72-f254-479f-a058-b3250c771f53 (51c05d72-f254-479f-a058-b3250c771f53): created successfully
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ae3240-7bf0-45f8-8082-07cb8a671725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:35 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Flow 'volume_create_manager' (a5d4415e-f8d9-446f-80d7-792a4eef8141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:35 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-60ca843a-a34b-40b3-a85c-6af76c5d4749 tempest-VolumesCloneNegativeTest-953338649 None] Created volume successfully.
Apr 10 10:38:36 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 1073741824" returned: 0 in 0.527s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:36 devstack sudo[88109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74
Apr 10 10:38:36 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:36 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74" returned: 0 in 0.434s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586b95e4-4d13-447b-8015-c1bb6282908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001e0800-a014-49e8-8933-5c65f70e2d74', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c76fe52-40b9-4bf6-9217-8c9108b7c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:36 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Volume volume-001e0800-a014-49e8-8933-5c65f70e2d74 (001e0800-a014-49e8-8933-5c65f70e2d74): created successfully
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c76fe52-40b9-4bf6-9217-8c9108b7c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (55182d19-ed58-4814-841a-c80aff7fc25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d8b1fc2e-f1e8-4b91-9cab-e9c4ab3554b2 tempest-VolumeDependencyTests-1591837227 None] Created volume successfully.
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Acquiring lock "cinder-51c05d72-f254-479f-a058-b3250c771f53-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Lock "cinder-51c05d72-f254-479f-a058-b3250c771f53-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Acquiring lock "cinder-quobyte-51c05d72-f254-479f-a058-b3250c771f53" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Lock "cinder-quobyte-51c05d72-f254-479f-a058-b3250c771f53" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d931ccdf-5a2d-467d-8953-f29cab0a8071]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:36 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53
Apr 10 10:38:36 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (605f179e-fa26-41cb-851d-216c511345ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2704605d-ca25-413b-aeac-7cf1f813c36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2704605d-ca25-413b-aeac-7cf1f813c36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1389274229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d651b5c8-47b5-42f3-b0fe-6782eed485c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6169106b76549ae954e547eb633fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=001e0800-a014-49e8-8933-5c65f70e2d74,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:37Z,use_quota=True,user_id='6fa919730b7b47b6bac10f419520edae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81feeac-d497-4827-bac7-7e246ad4240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81feeac-d497-4827-bac7-7e246ad4240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e722d8-c81b-45c8-ac47-d1e411c197f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e722d8-c81b-45c8-ac47-d1e411c197f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd651b5c8-47b5-42f3-b0fe-6782eed485c5', 'volume_name': 'volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5', 'volume_size': 1, 'source_volid': '001e0800-a014-49e8-8933-5c65f70e2d74', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0019a8cb-3675-4381-8c0a-a2a66239dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0019a8cb-3675-4381-8c0a-a2a66239dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb8123b-0e0b-442a-9c3d-15f4d5a76976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:37 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Volume d651b5c8-47b5-42f3-b0fe-6782eed485c5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5', 'volume_size': 1, 'source_volid': '001e0800-a014-49e8-8933-5c65f70e2d74', 'source_volstatus': 'available'}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:37 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Cloning volume 001e0800-a014-49e8-8933-5c65f70e2d74 to volume d651b5c8-47b5-42f3-b0fe-6782eed485c5
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Creating offline snapshot b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 of volume 001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2a424b-6b77-4e4e-ad58-45418a675997]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:37 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53" returned: 0 in 0.563s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:37 devstack sudo[88118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53
Apr 10 10:38:37 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:37 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74
Apr 10 10:38:37 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:37 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:37 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:37 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-51c05d72-f254-479f-a058-b3250c771f53" returned: 0 in 0.460s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Lock "cinder-quobyte-51c05d72-f254-479f-a058-b3250c771f53" released by "delete_volume" :: held 1.067s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Created reservations ['d36768e6-fbd6-4d7b-99f7-9104f4bdb477', '60f31ff9-8d2a-4b44-afa5-a8e20a345475', 'a8f521c3-c65e-45db-810c-bf85d0f18550', '2575d3a9-848c-4a1e-bc14-b313a1fb6f20'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:37 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74" returned: 0 in 0.618s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:37 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:37 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:37 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 1G
Apr 10 10:38:37 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:37 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.522s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:37 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:38 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.547s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:38 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:38 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Deleted volume successfully.
Apr 10 10:38:38 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f183f10b-aed8-4bb3-a98a-55a29d98f822 tempest-VolumesCloneNegativeTest-953338649 None] Lock "cinder-51c05d72-f254-479f-a058-b3250c771f53-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:38 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 1G" returned: 0 in 0.580s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001e0800-a014-49e8-8933-5c65f70e2d74 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:38 devstack sudo[88136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001e0800-a014-49e8-8933-5c65f70e2d74 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365
Apr 10 10:38:38 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:38 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001e0800-a014-49e8-8933-5c65f70e2d74 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" returned: 0 in 0.543s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:38 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 is being set with open permissions: ugo+rw
Apr 10 10:38:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:39 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365
Apr 10 10:38:39 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:39 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" returned: 0 in 0.523s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:39 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.info
Apr 10 10:38:39 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:40 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.info" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:40 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.info is being set with open permissions: ugo+rw
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:40 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.info
Apr 10 10:38:40 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:40 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.info" returned: 0 in 0.460s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-d651b5c8-47b5-42f3-b0fe-6782eed485c5" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-d651b5c8-47b5-42f3-b0fe-6782eed485c5" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] snapshot: b0ff2f9f-78b4-4194-ae8a-bdbcd593e365, volume: d651b5c8-47b5-42f3-b0fe-6782eed485c5,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79458a3-343b-4362-b53f-9adcc0d7ef21]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:40 devstack sudo[88151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365
Apr 10 10:38:40 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (af571de3-8451-4834-87dc-e852a0c973a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2571b412-ecf5-4487-b1c7-26b9cc36ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2571b412-ecf5-4487-b1c7-26b9cc36ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902745484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459ec2eb-ba05-4c49-99dd-b3f97a470998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:41Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659a43b8-5914-4dc7-b396-da824b1f2db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659a43b8-5914-4dc7-b396-da824b1f2db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd7eadc-f8ac-48b2-a04e-38edbdcfea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd7eadc-f8ac-48b2-a04e-38edbdcfea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459ec2eb-ba05-4c49-99dd-b3f97a470998', 'volume_name': 'volume-459ec2eb-ba05-4c49-99dd-b3f97a470998', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0aa83c6-def6-4784-9adf-39609eb877e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0aa83c6-def6-4784-9adf-39609eb877e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4199842-3658-437d-95c5-33bc8d0efc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:40 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume 459ec2eb-ba05-4c49-99dd-b3f97a470998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459ec2eb-ba05-4c49-99dd-b3f97a470998', 'volume_size': 1}
Apr 10 10:38:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:41 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" returned: 0 in 0.588s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-001e0800-a014-49e8-8933-5c65f70e2d74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bef9d8-0b22-4288-93a5-d36027718e59]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:41 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74
Apr 10 10:38:41 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:41 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74" returned: 0 in 0.524s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:38:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:41 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5
Apr 10 10:38:41 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:44 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5" returned: 0 in 2.373s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:44 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[0131f314-6533-4914-a00e-fecffac3c5fb]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:44 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74
Apr 10 10:38:44 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:44 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74" returned: 0 in 0.636s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:44 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:38:44 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Converted 1024.00 MB image at 431.28 MB/s
Apr 10 10:38:44 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 is being set with open permissions: ugo+rw
Apr 10 10:38:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:44 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5
Apr 10 10:38:44 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:45 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5" returned: 0 in 0.435s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-d651b5c8-47b5-42f3-b0fe-6782eed485c5" released by "_copy_volume_from_snapshot" :: held 4.605s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Deleting offline snapshot b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 of volume 001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] snapshot_file for this snap is: volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac8ec11-9ac2-436f-ab6f-c2bde2384b6e]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:45 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365
Apr 10 10:38:45 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:45 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-001e0800-a014-49e8-8933-5c65f70e2d74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bc8ea7-6894-4c39-947d-30d73f9cd9c9]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:45 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74
Apr 10 10:38:45 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:46 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74" returned: 0 in 0.508s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:46 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365
Apr 10 10:38:46 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:46 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" returned: 0 in 0.499s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:46 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365
Apr 10 10:38:46 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:47 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74.b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-b0ff2f9f-78b4-4194-ae8a-bdbcd593e365" released by "_delete_snapshot" :: held 2.086s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.174s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.415s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902745484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459ec2eb-ba05-4c49-99dd-b3f97a470998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:41Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Creating volume 459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:47 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb8123b-0e0b-442a-9c3d-15f4d5a76976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5', 'volume_size': 1, 'source_volid': '001e0800-a014-49e8-8933-5c65f70e2d74', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:47 devstack sudo[88201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 1073741824
Apr 10 10:38:47 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda8448d-2486-4d68-ba13-a4e4b09138c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:47 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Volume volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 (d651b5c8-47b5-42f3-b0fe-6782eed485c5): created successfully
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda8448d-2486-4d68-ba13-a4e4b09138c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Flow 'volume_create_manager' (605f179e-fa26-41cb-851d-216c511345ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:47 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4dae842c-15de-4998-bc68-c44be2170432 tempest-VolumeDependencyTests-1591837227 None] Created volume successfully.
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-001e0800-a014-49e8-8933-5c65f70e2d74-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-001e0800-a014-49e8-8933-5c65f70e2d74-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-001e0800-a014-49e8-8933-5c65f70e2d74" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-001e0800-a014-49e8-8933-5c65f70e2d74" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b5bd0-4a0b-4aa3-86b2-709bf68abe05]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:47 devstack sudo[88206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74
Apr 10 10:38:47 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:47 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 1073741824" returned: 0 in 0.530s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:47 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998
Apr 10 10:38:47 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:48 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74" returned: 0 in 0.520s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:48 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74
Apr 10 10:38:48 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:48 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998" returned: 0 in 0.449s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4199842-3658-437d-95c5-33bc8d0efc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459ec2eb-ba05-4c49-99dd-b3f97a470998', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdedcb21-212b-4415-9360-393155c22298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:48 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 (459ec2eb-ba05-4c49-99dd-b3f97a470998): created successfully
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdedcb21-212b-4415-9360-393155c22298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (af571de3-8451-4834-87dc-e852a0c973a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4eec3031-9ac3-4b98-8f91-0b591639092e tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created volume successfully.
Apr 10 10:38:48 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-001e0800-a014-49e8-8933-5c65f70e2d74" returned: 0 in 0.435s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-001e0800-a014-49e8-8933-5c65f70e2d74" released by "delete_volume" :: held 0.986s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Created reservations ['aac7e2d0-109c-4d86-a34f-42b6253e2c38', 'f9996dfe-b34d-4b7d-a79f-e29d7c5f6876', '8ba958f8-01d3-4bc9-9084-0dc29e0e5edb', '2450ffb4-cdc6-4c54-a8a1-75b0f01d090d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:48 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:48 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:49 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.392s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:49 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Deleted volume successfully.
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-b05ae096-7483-4707-acdf-08561c778f0f tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-001e0800-a014-49e8-8933-5c65f70e2d74-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Creating offline snapshot 54a3c111-4bee-4074-a217-daa9e9ea64e2 of volume 459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d75d08-7a31-4b4b-bdcc-3b3320f5f1f3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:49 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998
Apr 10 10:38:49 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-d651b5c8-47b5-42f3-b0fe-6782eed485c5-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-d651b5c8-47b5-42f3-b0fe-6782eed485c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-d651b5c8-47b5-42f3-b0fe-6782eed485c5" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-d651b5c8-47b5-42f3-b0fe-6782eed485c5" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b45bd02-ea45-43a6-8ee0-02f166473b6d]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:50 devstack sudo[88229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5
Apr 10 10:38:50 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:50 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998" returned: 0 in 0.506s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:50 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 1G
Apr 10 10:38:50 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:50 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5" returned: 0 in 0.482s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:50 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5
Apr 10 10:38:50 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:50 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 1G" returned: 0 in 0.497s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:50 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2
Apr 10 10:38:50 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:50 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d651b5c8-47b5-42f3-b0fe-6782eed485c5" returned: 0 in 0.466s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-d651b5c8-47b5-42f3-b0fe-6782eed485c5" released by "delete_volume" :: held 0.980s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:50 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Created reservations ['ee51ee8c-0778-4544-9dcb-ec22153a702b', '702b680c-09cd-40da-bb63-4a6e377d1649', '5f3ad7dd-4bc2-4434-83ea-f726c609768b', 'cdcccb23-efff-4201-96ed-fce4513a4e35'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:51 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:51 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:51 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2" returned: 0 in 0.501s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:51 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 is being set with open permissions: ugo+rw
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:51 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2
Apr 10 10:38:51 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:51 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.469s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:51 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Deleted volume successfully.
Apr 10 10:38:51 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2" returned: 0 in 0.449s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5cdb1e66-f7a9-45bd-86e5-60de9ca3676d tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-d651b5c8-47b5-42f3-b0fe-6782eed485c5-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:51 devstack sudo[88256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.info
Apr 10 10:38:51 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:52 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.info" returned: 0 in 0.495s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:52 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.info is being set with open permissions: ugo+rw
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:52 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.info
Apr 10 10:38:52 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "cinder-quobyte-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[12632d43-ec37-4afa-ac97-5ff13ee88321]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:52 devstack sudo[88261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67
Apr 10 10:38:52 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:52 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.info" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.082s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bc1d29d3-7e3d-4ca8-84b3-4e0cf54683cc tempest-CreateVolumesFromSnapshotTest-1913743579 None] Create snapshot completed successfully
Apr 10 10:38:52 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" returned: 0 in 0.554s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:52 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67
Apr 10 10:38:52 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:53 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" returned: 0 in 0.449s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-quobyte-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67" released by "delete_volume" :: held 1.041s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Created reservations ['6d328641-fb4a-4fc3-83f1-832c917de3c4', 'b026da79-fed7-4ea3-a9d1-2f114331c114', '76eba43b-cbf5-4019-816b-71d58ec6023d', '0063f37e-5811-44a6-ac11-5ca415b95984'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:53 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:38:53 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:53 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.466s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:38:53 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Deleted volume successfully.
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0d87be50-ffa3-44ec-a87b-c0b60bb37dd7 tempest-VolumeDependencyTests-1591837227 None] Lock "cinder-3cdf7214-fd24-4c9a-9d67-67a45ddbdf67-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (dda194ab-4cc6-4387-adbe-7aca29b15854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fccb07-c351-4f2a-9e10-793e98dfaf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fccb07-c351-4f2a-9e10-793e98dfaf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299889783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878248e7-cece-44ea-8400-7b214400819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec93cbf-4899-40db-9dbf-58112ae78ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec93cbf-4899-40db-9dbf-58112ae78ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c8c90d-b3d4-4086-af25-8661a43b1385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c8c90d-b3d4-4086-af25-8661a43b1385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878248e7-cece-44ea-8400-7b214400819c', 'volume_name': 'volume-878248e7-cece-44ea-8400-7b214400819c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2f59b-0467-48a9-8ac5-b11a5438e696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2f59b-0467-48a9-8ac5-b11a5438e696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26818ffc-e812-45ff-8d51-18ca69aab993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume 878248e7-cece-44ea-8400-7b214400819c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878248e7-cece-44ea-8400-7b214400819c', 'volume_size': 1}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299889783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878248e7-cece-44ea-8400-7b214400819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Creating volume 878248e7-cece-44ea-8400-7b214400819c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:54 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:54 devstack sudo[88273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c 1073741824
Apr 10 10:38:54 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (9c20f9dc-5c34-44c3-8bac-427f10ce8050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937da140-7614-41cd-9f3b-16963cfeaf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937da140-7614-41cd-9f3b-16963cfeaf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182462654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc711814-f7d4-412d-acf1-02070301615f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f9f829-0c0f-4ed4-bc1f-8ac0d932f63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f9f829-0c0f-4ed4-bc1f-8ac0d932f63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c5b20d-3d4c-487b-a5ba-b1a04d18a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c5b20d-3d4c-487b-a5ba-b1a04d18a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc711814-f7d4-412d-acf1-02070301615f', 'volume_name': 'volume-bc711814-f7d4-412d-acf1-02070301615f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c591459-fba2-48f1-9413-4c7d4df78aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c591459-fba2-48f1-9413-4c7d4df78aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8e1622-fc2e-419b-b3dc-04b58908ce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume bc711814-f7d4-412d-acf1-02070301615f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc711814-f7d4-412d-acf1-02070301615f', 'volume_size': 1}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (0063c83f-8e09-4afd-b7c1-522b67a7b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d637080-7064-4b26-ace8-e0618823b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d637080-7064-4b26-ace8-e0618823b342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377956339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55575980-5899-43c8-8b82-bc486d787b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69622e7d-7c29-4dd9-907b-66ea76ae98da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69622e7d-7c29-4dd9-907b-66ea76ae98da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0eedd2d-6051-4a84-bdda-acb73df83784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0eedd2d-6051-4a84-bdda-acb73df83784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55575980-5899-43c8-8b82-bc486d787b0a', 'volume_name': 'volume-55575980-5899-43c8-8b82-bc486d787b0a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757be31e-a9c7-42bd-a7b9-484961be04c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757be31e-a9c7-42bd-a7b9-484961be04c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e6989a-70dd-4256-bf8a-37a5f5dffdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume 55575980-5899-43c8-8b82-bc486d787b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55575980-5899-43c8-8b82-bc486d787b0a', 'volume_size': 1}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (0ab57e2d-509f-4877-b6a3-cbfdfe0003de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdd1e1e-5382-4699-aacb-6318a00d6100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdd1e1e-5382-4699-aacb-6318a00d6100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341897231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3926fb1f-cc56-49d0-b54b-5438d93e2c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:55Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04799b63-358c-4d32-bdbe-a640d5c6c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04799b63-358c-4d32-bdbe-a640d5c6c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0854d4cb-1962-48c8-9e80-bce0f6aa1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0854d4cb-1962-48c8-9e80-bce0f6aa1a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3926fb1f-cc56-49d0-b54b-5438d93e2c97', 'volume_name': 'volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d4e68a-e58d-4d98-b13b-97a75b83feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d4e68a-e58d-4d98-b13b-97a75b83feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9252c809-4921-4208-854d-eaffd3a69c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume 3926fb1f-cc56-49d0-b54b-5438d93e2c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97', 'volume_size': 1}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c 1073741824" returned: 0 in 0.811s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:54 devstack sudo[88278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c
Apr 10 10:38:54 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=142,cinder:UPDATE=169,cinder:DELETE=21,cinder:INSERT=48 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=146,cinder:UPDATE=216,cinder:INSERT=46,cinder:DELETE=12 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (1cec54d8-82a6-42c3-83c1-9070e84c3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5523222f-d727-4f44-bc6e-ff2016aaa3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5523222f-d727-4f44-bc6e-ff2016aaa3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622322206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6a9a6d-9523-45d6-b487-c95a0deaea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:55Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b179f27-e560-4742-b627-7c6048c69d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b179f27-e560-4742-b627-7c6048c69d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcac799e-9bcd-44d5-90b8-ea4483475767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcac799e-9bcd-44d5-90b8-ea4483475767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6a9a6d-9523-45d6-b487-c95a0deaea5a', 'volume_name': 'volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab03e1b4-1799-43c2-b748-6f7f1c35a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab03e1b4-1799-43c2-b748-6f7f1c35a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f0304-1085-4bc6-8638-86f5a8a0d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:55 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume ec6a9a6d-9523-45d6-b487-c95a0deaea5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a', 'volume_size': 1}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:55 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c" returned: 0 in 0.588s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182462654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc711814-f7d4-412d-acf1-02070301615f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Creating volume bc711814-f7d4-412d-acf1-02070301615f {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:55 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26818ffc-e812-45ff-8d51-18ca69aab993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878248e7-cece-44ea-8400-7b214400819c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb272da-f8df-4fec-800d-cbf60da213f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:55 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume volume-878248e7-cece-44ea-8400-7b214400819c (878248e7-cece-44ea-8400-7b214400819c): created successfully
Apr 10 10:38:55 devstack sudo[88281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f 1073741824
Apr 10 10:38:55 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb272da-f8df-4fec-800d-cbf60da213f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (dda194ab-4cc6-4387-adbe-7aca29b15854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bbd4b84e-4054-4eac-9310-6015c83b67cb tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created volume successfully.
Apr 10 10:38:56 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f 1073741824" returned: 0 in 0.550s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:56 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f
Apr 10 10:38:56 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:56 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f" returned: 0 in 0.420s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.885s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377956339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55575980-5899-43c8-8b82-bc486d787b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Creating volume 55575980-5899-43c8-8b82-bc486d787b0a {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:56 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8e1622-fc2e-419b-b3dc-04b58908ce7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc711814-f7d4-412d-acf1-02070301615f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:56 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a 1073741824
Apr 10 10:38:56 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2dcde4-5642-432d-947e-810f3e5783e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:56 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume volume-bc711814-f7d4-412d-acf1-02070301615f (bc711814-f7d4-412d-acf1-02070301615f): created successfully
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2dcde4-5642-432d-947e-810f3e5783e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (9c20f9dc-5c34-44c3-8bac-427f10ce8050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7bac236c-d7bf-46f5-848b-e2cb7f5bc33c tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created volume successfully.
Apr 10 10:38:57 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a 1073741824" returned: 0 in 0.513s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:57 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a
Apr 10 10:38:57 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:57 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a" returned: 0 in 0.455s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.636s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341897231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3926fb1f-cc56-49d0-b54b-5438d93e2c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:55Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Creating volume 3926fb1f-cc56-49d0-b54b-5438d93e2c97 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:57 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:57 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97 1073741824
Apr 10 10:38:57 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e6989a-70dd-4256-bf8a-37a5f5dffdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55575980-5899-43c8-8b82-bc486d787b0a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ea401b-ce32-4b6d-9985-89720bea7688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:57 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume volume-55575980-5899-43c8-8b82-bc486d787b0a (55575980-5899-43c8-8b82-bc486d787b0a): created successfully
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ea401b-ce32-4b6d-9985-89720bea7688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (0063c83f-8e09-4afd-b7c1-522b67a7b783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-0e16cc42-ec92-4c4d-ab71-861266a597e4 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created volume successfully.
Apr 10 10:38:58 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97 1073741824" returned: 0 in 0.541s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:58 devstack sudo[88334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97
Apr 10 10:38:58 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:58 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97" returned: 0 in 0.477s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.341s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622322206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6a9a6d-9523-45d6-b487-c95a0deaea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1a6effbda5497ca6210f495c375b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:55Z,use_quota=True,user_id='03ae42209f6541b3bc3a82dc9a7ab121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Creating volume ec6a9a6d-9523-45d6-b487-c95a0deaea5a {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:38:58 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9252c809-4921-4208-854d-eaffd3a69c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4610c95b-5e42-42b3-96d5-9cbac3c49c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:58 devstack sudo[88339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a 1073741824
Apr 10 10:38:58 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:58 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97 (3926fb1f-cc56-49d0-b54b-5438d93e2c97): created successfully
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4610c95b-5e42-42b3-96d5-9cbac3c49c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (0ab57e2d-509f-4877-b6a3-cbfdfe0003de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:58 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d03fadb4-5316-4293-b424-d94e09d55d73 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created volume successfully.
Apr 10 10:38:59 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a 1073741824" returned: 0 in 0.625s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:38:59 devstack sudo[88344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a
Apr 10 10:38:59 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:38:59 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a" returned: 0 in 0.574s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f0304-1085-4bc6-8638-86f5a8a0d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddbf69e-12fe-474b-adf9-e99d49096062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:38:59 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Volume volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a (ec6a9a6d-9523-45d6-b487-c95a0deaea5a): created successfully
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddbf69e-12fe-474b-adf9-e99d49096062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:38:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Flow 'volume_create_manager' (1cec54d8-82a6-42c3-83c1-9070e84c3b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:38:59 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bff9b573-76ba-43fd-ad77-28ca178936d0 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created volume successfully.
Apr 10 10:39:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-ec6a9a6d-9523-45d6-b487-c95a0deaea5a-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-ec6a9a6d-9523-45d6-b487-c95a0deaea5a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-ec6a9a6d-9523-45d6-b487-c95a0deaea5a" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-ec6a9a6d-9523-45d6-b487-c95a0deaea5a" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:00 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[5584b00d-c8b4-413e-80b6-195ae001bff0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:00 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a
Apr 10 10:39:00 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:01 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a" returned: 0 in 0.467s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:01 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a
Apr 10 10:39:01 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:01 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-ec6a9a6d-9523-45d6-b487-c95a0deaea5a" returned: 0 in 0.436s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-ec6a9a6d-9523-45d6-b487-c95a0deaea5a" released by "delete_volume" :: held 0.934s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created reservations ['0d9c05a4-6439-4175-a850-d5ab0cb42c4a', 'b48bb142-6c12-441f-adf3-094ab06fdf42', 'a4551840-d99c-43c0-8fde-c017ed241fe1', '810132fd-159c-42ac-9d51-f91a32da2834'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:01 devstack sudo[88356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:01 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-3926fb1f-cc56-49d0-b54b-5438d93e2c97-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-3926fb1f-cc56-49d0-b54b-5438d93e2c97-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-3926fb1f-cc56-49d0-b54b-5438d93e2c97" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-3926fb1f-cc56-49d0-b54b-5438d93e2c97" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[09311dfc-0b62-46ee-b060-7c26256d7e3a]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:01 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97
Apr 10 10:39:01 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:02 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.537s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:02 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Deleted volume successfully.
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-5413362d-d721-43a3-bb4b-96b88dffd65b tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-ec6a9a6d-9523-45d6-b487-c95a0deaea5a-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:02 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97" returned: 0 in 0.586s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:02 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97
Apr 10 10:39:02 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:02 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3926fb1f-cc56-49d0-b54b-5438d93e2c97" returned: 0 in 0.470s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-3926fb1f-cc56-49d0-b54b-5438d93e2c97" released by "delete_volume" :: held 1.094s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:02 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created reservations ['90e09915-0cd1-4631-934e-2ab4f8115ddb', '50dcd076-33dc-4b00-b507-e8e1d0a4c222', '3613174b-ea09-4d19-8eca-10bc599e556b', '8c2c24a3-d075-4a93-a67b-4b711704375c'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:03 devstack sudo[88367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:03 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:03 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.475s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Deleted volume successfully.
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9bf70ed9-c6bc-4f1c-94e4-d6d01d1125de tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-3926fb1f-cc56-49d0-b54b-5438d93e2c97-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-55575980-5899-43c8-8b82-bc486d787b0a-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-55575980-5899-43c8-8b82-bc486d787b0a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-55575980-5899-43c8-8b82-bc486d787b0a" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-55575980-5899-43c8-8b82-bc486d787b0a" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:04 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cb390c-89a1-4a8e-8214-4ac3c6629602]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:04 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a
Apr 10 10:39:04 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:04 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a" returned: 0 in 0.517s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:04 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a
Apr 10 10:39:04 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:05 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-55575980-5899-43c8-8b82-bc486d787b0a" returned: 0 in 0.436s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-55575980-5899-43c8-8b82-bc486d787b0a" released by "delete_volume" :: held 0.980s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created reservations ['07ac9d24-d584-44a2-8a8c-96664ce95e1f', '6637d7dc-e694-4c32-b5da-300900e0e825', '2d659a6d-6cc1-4cd2-9110-cf06e9a6b8c2', 'c5f958cc-e3d1-4194-911f-5832e1e37d85'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:05 devstack sudo[88378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:05 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:05 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.469s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:05 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Deleted volume successfully.
Apr 10 10:39:05 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-9ea72309-f349-4a8d-9110-bee1619b0907 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-55575980-5899-43c8-8b82-bc486d787b0a-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-bc711814-f7d4-412d-acf1-02070301615f-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-bc711814-f7d4-412d-acf1-02070301615f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-bc711814-f7d4-412d-acf1-02070301615f" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-bc711814-f7d4-412d-acf1-02070301615f" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a353bc-a902-4170-826b-569e623c906e]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:06 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f
Apr 10 10:39:06 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:06 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f" returned: 0 in 0.462s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:06 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f
Apr 10 10:39:06 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:07 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-bc711814-f7d4-412d-acf1-02070301615f" returned: 0 in 0.405s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-bc711814-f7d4-412d-acf1-02070301615f" released by "delete_volume" :: held 0.891s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created reservations ['aaec5109-9040-4501-b893-bbb75cd85938', '9e324ecc-b605-45de-91c0-bfeafe40cdf0', '3f55167c-c0cf-4f18-a98b-85d1af7c2942', '6ef4b8c2-3aaa-446b-ace3-2c3ceb8c6a07'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:07 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:07 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-878248e7-cece-44ea-8400-7b214400819c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-878248e7-cece-44ea-8400-7b214400819c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-878248e7-cece-44ea-8400-7b214400819c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-878248e7-cece-44ea-8400-7b214400819c" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9cf8cc-29c9-4553-9eb7-83faacff78f3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:07 devstack sudo[88391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c
Apr 10 10:39:07 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:07 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.472s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:07 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Deleted volume successfully.
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-30cc7857-4056-4911-9f93-23cecfc50d46 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-bc711814-f7d4-412d-acf1-02070301615f-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:07 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c" returned: 0 in 0.497s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:07 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c
Apr 10 10:39:07 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:08 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-878248e7-cece-44ea-8400-7b214400819c" returned: 0 in 0.436s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-878248e7-cece-44ea-8400-7b214400819c" released by "delete_volume" :: held 0.968s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created reservations ['bfe1b55a-ba2d-43f7-9916-ac141ade3918', '32313c51-8eef-475c-bdfc-d9304b76b259', 'cdb43e60-cbd1-4dd5-a173-023cc939839a', '5eb62005-6f81-426a-b552-f0b3751e2dce'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-54a3c111-4bee-4074-a217-daa9e9ea64e2-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:08 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:08 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-54a3c111-4bee-4074-a217-daa9e9ea64e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-459ec2eb-ba05-4c49-99dd-b3f97a470998" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-459ec2eb-ba05-4c49-99dd-b3f97a470998" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-54a3c111-4bee-4074-a217-daa9e9ea64e2" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-54a3c111-4bee-4074-a217-daa9e9ea64e2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Deleting offline snapshot 54a3c111-4bee-4074-a217-daa9e9ea64e2 of volume 459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] snapshot_file for this snap is: volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb5596-8237-4c94-ace4-543e5f263d94]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:08 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2
Apr 10 10:39:08 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:08 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.476s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:08 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Deleted volume successfully.
Apr 10 10:39:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-62a4f388-0ad8-4637-81a9-aa909d001fef tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-878248e7-cece-44ea-8400-7b214400819c-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:09 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2" returned: 0 in 0.513s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:09 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ec2eb-ba05-4c49-99dd-b3f97a470998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:39:09 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[448afbd2-16e2-49d0-a3ae-1841b752e411]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:09 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998
Apr 10 10:39:09 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:09 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:09 devstack sudo[88414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2
Apr 10 10:39:09 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:10 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2" returned: 0 in 0.472s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:10 devstack sudo[88419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2
Apr 10 10:39:10 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:10 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998.54a3c111-4bee-4074-a217-daa9e9ea64e2" returned: 0 in 0.425s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-54a3c111-4bee-4074-a217-daa9e9ea64e2" released by "_delete_snapshot" :: held 1.984s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-459ec2eb-ba05-4c49-99dd-b3f97a470998" released by "delete_snapshot" :: held 2.000s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:10 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created reservations ['d116240c-c76d-44b2-a600-4c3bf43517df', '4b5ae27b-6937-4495-bd48-9248fe2605f0', 'ebe52008-719b-4578-ab50-45dc31d974e2', '4b99f546-0c8c-4448-89cb-fb5b6f2d77fe'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:10 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Delete snapshot completed successfully.
Apr 10 10:39:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ec81b477-f2f5-4bf2-a73c-d39390df1180 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-54a3c111-4bee-4074-a217-daa9e9ea64e2-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-459ec2eb-ba05-4c49-99dd-b3f97a470998-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-459ec2eb-ba05-4c49-99dd-b3f97a470998-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "cinder-quobyte-459ec2eb-ba05-4c49-99dd-b3f97a470998" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-459ec2eb-ba05-4c49-99dd-b3f97a470998" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:11 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdde0ff-4408-462b-82a5-2d4bdb1f56e0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:11 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998
Apr 10 10:39:11 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:12 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998" returned: 0 in 0.581s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:12 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998
Apr 10 10:39:12 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:12 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-459ec2eb-ba05-4c49-99dd-b3f97a470998" returned: 0 in 0.491s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-quobyte-459ec2eb-ba05-4c49-99dd-b3f97a470998" released by "delete_volume" :: held 1.110s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Created reservations ['10506414-98cf-435c-b58b-f541af726a39', '4adb01ca-9a47-4e9e-b7e4-808c01c03942', '21d6ef04-0fc8-4b2d-a311-2a96d618fa08', '00115b6d-b27e-455f-ba47-19f37b799be9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:12 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:12 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:13 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.460s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:13 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:13 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Deleted volume successfully.
Apr 10 10:39:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-11bbda61-0106-490c-9891-109cbecef3f8 tempest-CreateVolumesFromSnapshotTest-1913743579 None] Lock "cinder-459ec2eb-ba05-4c49-99dd-b3f97a470998-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Flow 'volume_create_manager' (d11dc127-551c-4285-b73d-5c9cbb1f4467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc16b785-6139-4400-962a-bb76a1e4f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc16b785-6139-4400-962a-bb76a1e4f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de7151c-de85-4d30-be44-2d870da6a846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7317cdcf381e4d988032759ec4a844e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:16Z,use_quota=True,user_id='af0d0adf4a47422a81884efc2abbcb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603082e0-a097-42ff-89dd-6753dfb129b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603082e0-a097-42ff-89dd-6753dfb129b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74ca2aa-d12b-4ea5-bc5d-2daa3b7af0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74ca2aa-d12b-4ea5-bc5d-2daa3b7af0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de7151c-de85-4d30-be44-2d870da6a846', 'volume_name': 'volume-9de7151c-de85-4d30-be44-2d870da6a846', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f77d84-a2d1-43c4-b2e0-113b4ac65f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f77d84-a2d1-43c4-b2e0-113b4ac65f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102bce61-8bdd-4ec3-a5e7-0e9473ae59b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:15 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Volume 9de7151c-de85-4d30-be44-2d870da6a846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de7151c-de85-4d30-be44-2d870da6a846', 'volume_size': 1}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de7151c-de85-4d30-be44-2d870da6a846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7317cdcf381e4d988032759ec4a844e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:16Z,use_quota=True,user_id='af0d0adf4a47422a81884efc2abbcb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Creating volume 9de7151c-de85-4d30-be44-2d870da6a846 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:39:15 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:39:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:15 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846 1073741824
Apr 10 10:39:15 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:16 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846 1073741824" returned: 0 in 0.648s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:16 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846
Apr 10 10:39:16 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:17 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846" returned: 0 in 0.484s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:39:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102bce61-8bdd-4ec3-a5e7-0e9473ae59b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de7151c-de85-4d30-be44-2d870da6a846', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dcabc8-394a-4753-aa4d-024817f89561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Volume volume-9de7151c-de85-4d30-be44-2d870da6a846 (9de7151c-de85-4d30-be44-2d870da6a846): created successfully
Apr 10 10:39:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dcabc8-394a-4753-aa4d-024817f89561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Flow 'volume_create_manager' (d11dc127-551c-4285-b73d-5c9cbb1f4467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:17 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4d5043c4-a7cc-4141-aeb6-2b7573fc419b tempest-CinderUnicodeTest-2090159630 None] Created volume successfully.
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Flow 'volume_create_manager' (b08f7c16-c527-41ed-8afb-522083598c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9720c0eb-d603-4f0e-bbae-edf064ed0072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9720c0eb-d603-4f0e-bbae-edf064ed0072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:39:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-315316088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7fb23b-0a7a-441b-bca7-8f590b9b8241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7317cdcf381e4d988032759ec4a844e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:18Z,use_quota=True,user_id='af0d0adf4a47422a81884efc2abbcb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea821cb-9400-4643-90ec-814bc42fbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea821cb-9400-4643-90ec-814bc42fbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720253f8-ab01-45fc-aeff-dafcd991ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720253f8-ab01-45fc-aeff-dafcd991ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7fb23b-0a7a-441b-bca7-8f590b9b8241', 'volume_name': 'volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b1f511-1ecb-4bb3-92e7-4d306909e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b1f511-1ecb-4bb3-92e7-4d306909e620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d740343-74ba-4691-a3b3-844c0f7a0ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:18 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Volume 6e7fb23b-0a7a-441b-bca7-8f590b9b8241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241', 'volume_size': 1}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:39:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-315316088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7fb23b-0a7a-441b-bca7-8f590b9b8241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7317cdcf381e4d988032759ec4a844e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:18Z,use_quota=True,user_id='af0d0adf4a47422a81884efc2abbcb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Creating volume 6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:39:18 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:18 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 1073741824
Apr 10 10:39:18 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:18 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 1073741824" returned: 0 in 0.498s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:18 devstack sudo[88446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241
Apr 10 10:39:18 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:19 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" returned: 0 in 0.453s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:39:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d740343-74ba-4691-a3b3-844c0f7a0ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5407d0-84cc-419d-85ef-70116199015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:19 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Volume volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 (6e7fb23b-0a7a-441b-bca7-8f590b9b8241): created successfully
Apr 10 10:39:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5407d0-84cc-419d-85ef-70116199015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Flow 'volume_create_manager' (b08f7c16-c527-41ed-8afb-522083598c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-155f84b0-8a76-43f5-922f-1a1e6ed81166 tempest-CinderUnicodeTest-2090159630 None] Created volume successfully.
Apr 10 10:39:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Creating offline snapshot 9f5c770a-4e4d-47c8-a64e-fbeb990acb83 of volume 6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:39:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73ab57d-4f7b-4d90-b1d4-eb67554d8d82]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:20 devstack sudo[88450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241
Apr 10 10:39:20 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:21 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" returned: 0 in 0.495s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:21 devstack sudo[88455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 1G
Apr 10 10:39:21 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:21 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 1G" returned: 0 in 0.489s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:21 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83
Apr 10 10:39:21 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:22 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83" returned: 0 in 0.428s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:22 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 is being set with open permissions: ugo+rw
Apr 10 10:39:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:22 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83
Apr 10 10:39:22 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:22 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83" returned: 0 in 0.421s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:22 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.info
Apr 10 10:39:22 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:22 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.info" returned: 0 in 0.432s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:22 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.info is being set with open permissions: ugo+rw
Apr 10 10:39:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:22 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.info
Apr 10 10:39:22 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:23 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.info" returned: 0 in 0.420s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:23 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-708c23f3-2110-4201-8370-d23941884461 tempest-CinderUnicodeTest-2090159630 None] Create snapshot completed successfully
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "cinder-9f5c770a-4e4d-47c8-a64e-fbeb990acb83-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-9f5c770a-4e4d-47c8-a64e-fbeb990acb83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "cinder-quobyte-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "cinder-quobyte-9f5c770a-4e4d-47c8-a64e-fbeb990acb83" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-9f5c770a-4e4d-47c8-a64e-fbeb990acb83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Deleting offline snapshot 9f5c770a-4e4d-47c8-a64e-fbeb990acb83 of volume 6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] snapshot_file for this snap is: volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f9134b-2c67-457c-a718-9f63efa362b5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:23 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83
Apr 10 10:39:23 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:24 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83" returned: 0 in 0.523s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:39:24 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[074d111a-2fb2-49bb-8600-5781c80144f9]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:24 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241
Apr 10 10:39:24 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:24 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" returned: 0 in 0.508s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:24 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83
Apr 10 10:39:24 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:25 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83" returned: 0 in 0.599s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:25 devstack sudo[88491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83
Apr 10 10:39:25 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:25 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241.9f5c770a-4e4d-47c8-a64e-fbeb990acb83" returned: 0 in 0.494s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-9f5c770a-4e4d-47c8-a64e-fbeb990acb83" released by "_delete_snapshot" :: held 2.197s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" released by "delete_snapshot" :: held 2.216s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Created reservations ['65d3bd86-2c8a-4eda-a497-3bae326f5cd8', 'b0ba9977-7917-42ed-be38-7d34840377c5', 'ab7c9f6f-6eb4-4294-8b22-9bedca2f9bc7', '6e8a2583-f1fb-42e8-badb-c46759a68a3f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:26 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Delete snapshot completed successfully.
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-95ecb861-9f36-490b-ba73-dd91316b1bd7 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-9f5c770a-4e4d-47c8-a64e-fbeb990acb83-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "cinder-6e7fb23b-0a7a-441b-bca7-8f590b9b8241-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-6e7fb23b-0a7a-441b-bca7-8f590b9b8241-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "cinder-quobyte-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:27 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e279496-8742-478d-b998-c32f4f376f3f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:27 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241
Apr 10 10:39:27 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:27 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" returned: 0 in 0.494s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:27 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241
Apr 10 10:39:27 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:27 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" returned: 0 in 0.427s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-6e7fb23b-0a7a-441b-bca7-8f590b9b8241" released by "delete_volume" :: held 0.955s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:27 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Created reservations ['a39edd25-38d2-4b20-ba8f-3176db17b43b', '7aa1c027-3a8f-4424-90e4-fb23ea2197dc', '43b9f644-dee5-4cac-b69a-2ad1c667e87e', '46502a41-fa24-4cb2-87ad-528d6064542c'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:28 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:28 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "cinder-9de7151c-de85-4d30-be44-2d870da6a846-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-9de7151c-de85-4d30-be44-2d870da6a846-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "cinder-quobyte-9de7151c-de85-4d30-be44-2d870da6a846" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-9de7151c-de85-4d30-be44-2d870da6a846" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e20773-b5fb-49af-aa39-a5d27c67b824]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:28 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846
Apr 10 10:39:28 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:28 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.478s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Deleted volume successfully.
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ef315ca4-ac9a-49ad-ad3d-248c3e080a03 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-6e7fb23b-0a7a-441b-bca7-8f590b9b8241-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:28 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846" returned: 0 in 0.561s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:28 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846
Apr 10 10:39:28 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:29 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9de7151c-de85-4d30-be44-2d870da6a846" returned: 0 in 0.483s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-quobyte-9de7151c-de85-4d30-be44-2d870da6a846" released by "delete_volume" :: held 1.066s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Created reservations ['f2628d25-071a-482a-a524-a9e5517ae83b', '3f53f5fe-0885-4841-8186-afb11e11635c', '3a8535d3-d425-43f3-a212-6db373dc2ef6', 'cb707e70-31f5-40a9-8582-688f797fb67c'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:29 devstack sudo[88513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:29 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:29 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.529s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Deleted volume successfully.
Apr 10 10:39:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-51a16c7a-b2f9-42ca-acde-e12a0dbec452 tempest-CinderUnicodeTest-2090159630 None] Lock "cinder-9de7151c-de85-4d30-be44-2d870da6a846-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:37 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:39:37 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:37 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.532s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:37 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:39:39 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=54,cinder:UPDATE=85,cinder:DELETE=8,cinder:INSERT=26 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:39:39 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:UPDATE=103,cinder:SELECT=72,cinder:INSERT=21,cinder:DELETE=8 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Flow 'volume_create_manager' (204737bd-5763-4bfa-ac2b-25b27f47cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9f5d83-1ca9-427e-baaf-8260634c8692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9f5d83-1ca9-427e-baaf-8260634c8692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-248456090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73af48e1-1c05-4f9f-897b-8e5d0b8382f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb34bfc9c7cd4cb6a2f9ee8f8c0f8138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:47Z,use_quota=True,user_id='9bfe742185a14269bb0dea5e8e2ce86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d3b3cb-183f-400c-815e-73b3057984ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d3b3cb-183f-400c-815e-73b3057984ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04654e1d-daf9-4fb9-9870-cc04cf802160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04654e1d-daf9-4fb9-9870-cc04cf802160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73af48e1-1c05-4f9f-897b-8e5d0b8382f2', 'volume_name': 'volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396334ad-f88b-477b-8389-44f8f866b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396334ad-f88b-477b-8389-44f8f866b52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c6a4f7-1e59-4bee-8179-c0bace6126c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:47 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Volume 73af48e1-1c05-4f9f-897b-8e5d0b8382f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2', 'volume_size': 1}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-248456090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73af48e1-1c05-4f9f-897b-8e5d0b8382f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb34bfc9c7cd4cb6a2f9ee8f8c0f8138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:47Z,use_quota=True,user_id='9bfe742185a14269bb0dea5e8e2ce86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Creating volume 73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:39:47 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:47 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 1073741824
Apr 10 10:39:47 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:47 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 1073741824" returned: 0 in 0.539s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:47 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2
Apr 10 10:39:47 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:48 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" returned: 0 in 0.464s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:39:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c6a4f7-1e59-4bee-8179-c0bace6126c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894c4264-b051-4fbc-b4ac-74fb0c704530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:48 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Volume volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 (73af48e1-1c05-4f9f-897b-8e5d0b8382f2): created successfully
Apr 10 10:39:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894c4264-b051-4fbc-b4ac-74fb0c704530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Flow 'volume_create_manager' (204737bd-5763-4bfa-ac2b-25b27f47cafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1bc8d82a-1ee8-44b4-82df-3c661ca3b65b tempest-SnapshotDependencyTests-451811651 None] Created volume successfully.
Apr 10 10:39:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Creating offline snapshot 11d59268-add7-4007-ba2a-02b931340c8c of volume 73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:39:49 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[7968be48-c411-4e84-8c14-6b20f4a73793]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:49 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2
Apr 10 10:39:49 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:49 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" returned: 0 in 0.501s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:49 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c 1G
Apr 10 10:39:49 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:50 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c 1G" returned: 0 in 0.517s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:50 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c
Apr 10 10:39:50 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:50 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c" returned: 0 in 0.429s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:50 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c is being set with open permissions: ugo+rw
Apr 10 10:39:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:50 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c
Apr 10 10:39:50 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:51 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c" returned: 0 in 0.455s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:51 devstack sudo[88557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.info
Apr 10 10:39:51 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:51 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.info" returned: 0 in 0.451s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:51 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.info is being set with open permissions: ugo+rw
Apr 10 10:39:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:51 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.info
Apr 10 10:39:51 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:52 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.info" returned: 0 in 0.433s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.855s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:52 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-10fdc6e8-2432-4d9d-af19-faf82375ed9a tempest-SnapshotDependencyTests-451811651 None] Create snapshot completed successfully
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Flow 'volume_create_manager' (23fd3673-a652-4509-803a-347f96806322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dd0669-0d5b-4eac-8ccf-15582a3b76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dd0669-0d5b-4eac-8ccf-15582a3b76b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf228c42-dd4e-4e90-a889-e0453a46ebb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb34bfc9c7cd4cb6a2f9ee8f8c0f8138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11d59268-add7-4007-ba2a-02b931340c8c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:53Z,use_quota=True,user_id='9bfe742185a14269bb0dea5e8e2ce86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbfb7cf-c1e5-4166-ae9e-20594ef67bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbfb7cf-c1e5-4166-ae9e-20594ef67bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4df1243-aeb5-490a-84b6-4db0eaba6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4df1243-aeb5-490a-84b6-4db0eaba6344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf228c42-dd4e-4e90-a889-e0453a46ebb8', 'volume_name': 'volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8', 'volume_size': 1, 'snapshot_id': '11d59268-add7-4007-ba2a-02b931340c8c'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96da2a9-f51f-4db4-964e-963aa5acd054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96da2a9-f51f-4db4-964e-963aa5acd054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc0261-12e6-448a-9ff6-e2d245ea30cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:52 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Volume cf228c42-dd4e-4e90-a889-e0453a46ebb8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8', 'volume_size': 1, 'snapshot_id': '11d59268-add7-4007-ba2a-02b931340c8c'}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-quobyte-11d59268-add7-4007-ba2a-02b931340c8c-cf228c42-dd4e-4e90-a889-e0453a46ebb8" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-11d59268-add7-4007-ba2a-02b931340c8c-cf228c42-dd4e-4e90-a889-e0453a46ebb8" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Creating volume cf228c42-dd4e-4e90-a889-e0453a46ebb8 from snapshot 11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-quobyte-cf228c42-dd4e-4e90-a889-e0453a46ebb8" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-cf228c42-dd4e-4e90-a889-e0453a46ebb8" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] snapshot: 11d59268-add7-4007-ba2a-02b931340c8c, volume: cf228c42-dd4e-4e90-a889-e0453a46ebb8,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b70b6a9-5a1e-4632-b669-6573f8b7286b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:52 devstack sudo[88563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c
Apr 10 10:39:52 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:53 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c" returned: 0 in 0.491s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f75b8a-5e74-45fa-a942-c0a691a92ebf]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:53 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2
Apr 10 10:39:53 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:53 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" returned: 0 in 0.509s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:39:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:53 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8
Apr 10 10:39:53 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:55 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8" returned: 0 in 1.997s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:55 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ae0dd-d740-47d0-80ae-9cc950ed9b9b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:55 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2
Apr 10 10:39:55 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:56 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" returned: 0 in 0.643s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:56 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:39:56 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Converted 1024.00 MB image at 512.53 MB/s
Apr 10 10:39:56 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 is being set with open permissions: ugo+rw
Apr 10 10:39:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:56 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8
Apr 10 10:39:56 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:57 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8" returned: 0 in 0.459s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-cf228c42-dd4e-4e90-a889-e0453a46ebb8" released by "_copy_volume_from_snapshot" :: held 4.167s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-11d59268-add7-4007-ba2a-02b931340c8c-cf228c42-dd4e-4e90-a889-e0453a46ebb8" released by "_create_volume_from_snapshot" :: held 4.184s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.193s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc0261-12e6-448a-9ff6-e2d245ea30cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8', 'volume_size': 1, 'snapshot_id': '11d59268-add7-4007-ba2a-02b931340c8c'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70bd315-095e-4fc5-820c-798e08b407b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:39:57 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Volume volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 (cf228c42-dd4e-4e90-a889-e0453a46ebb8): created successfully
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70bd315-095e-4fc5-820c-798e08b407b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:39:57 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Flow 'volume_create_manager' (23fd3673-a652-4509-803a-347f96806322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:39:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-68d82fe4-33e7-4abf-a021-ae5a941a6656 tempest-SnapshotDependencyTests-451811651 None] Created volume successfully.
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-11d59268-add7-4007-ba2a-02b931340c8c-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-11d59268-add7-4007-ba2a-02b931340c8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-quobyte-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-quobyte-11d59268-add7-4007-ba2a-02b931340c8c" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-11d59268-add7-4007-ba2a-02b931340c8c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Deleting offline snapshot 11d59268-add7-4007-ba2a-02b931340c8c of volume 73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] snapshot_file for this snap is: volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa05dfe-1cd3-42db-9df3-d5df39173a9f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:58 devstack sudo[88593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c
Apr 10 10:39:58 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:58 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c" returned: 0 in 0.525s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1a6123-ea15-475f-812b-43e304b8efbc]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:39:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:58 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2
Apr 10 10:39:58 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:59 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" returned: 0 in 0.483s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:59 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c
Apr 10 10:39:59 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:39:59 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 10 10:39:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c" returned: 0 in 0.474s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:39:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:39:59 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c
Apr 10 10:39:59 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:00 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2.11d59268-add7-4007-ba2a-02b931340c8c" returned: 0 in 0.431s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-11d59268-add7-4007-ba2a-02b931340c8c" released by "_delete_snapshot" :: held 1.968s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" released by "delete_snapshot" :: held 1.982s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Created reservations ['86bbddda-96f3-4061-971d-796ffd02fecc', 'cae18f09-b9a9-4634-91d0-616b9a32369b', '9eaee26b-70e9-4c2b-afc0-b36900d438d7', '2cea2665-70ff-4121-b934-1816681d2b22'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:00 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Delete snapshot completed successfully.
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-76d4c366-dc4f-4c91-bd14-cab46eb59c82 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-11d59268-add7-4007-ba2a-02b931340c8c-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-73af48e1-1c05-4f9f-897b-8e5d0b8382f2-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-73af48e1-1c05-4f9f-897b-8e5d0b8382f2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-quobyte-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdca5f3-2133-4754-b03c-e80c60cf4bb7]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:00 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2
Apr 10 10:40:00 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:00 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" returned: 0 in 0.509s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:00 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2
Apr 10 10:40:00 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:01 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" returned: 0 in 0.491s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-73af48e1-1c05-4f9f-897b-8e5d0b8382f2" released by "delete_volume" :: held 1.071s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Created reservations ['84e8bf1a-f944-4b56-b324-df5d30ea8a53', 'c08b48d1-bcaa-4ede-8262-8362ae24a9b0', '506e37b2-d546-4626-8f3b-bb36972932e5', 'da9e7bef-abff-4f1b-9993-f1cd2ea0dc40'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:01 devstack sudo[88654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:01 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:01 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.425s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:01 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Deleted volume successfully.
Apr 10 10:40:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-00748a20-1798-4fa4-8890-b8dcdfb5a9a4 tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-73af48e1-1c05-4f9f-897b-8e5d0b8382f2-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-cf228c42-dd4e-4e90-a889-e0453a46ebb8-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-cf228c42-dd4e-4e90-a889-e0453a46ebb8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "cinder-quobyte-cf228c42-dd4e-4e90-a889-e0453a46ebb8" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-cf228c42-dd4e-4e90-a889-e0453a46ebb8" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:02 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[14804247-b309-42fa-94a5-d30e039084d5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:02 devstack sudo[88657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8
Apr 10 10:40:02 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:03 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8" returned: 0 in 0.474s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:03 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8
Apr 10 10:40:03 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:03 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-cf228c42-dd4e-4e90-a889-e0453a46ebb8" returned: 0 in 0.424s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-quobyte-cf228c42-dd4e-4e90-a889-e0453a46ebb8" released by "delete_volume" :: held 0.926s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Created reservations ['ba75d3c9-dd42-4ab7-9ac8-759b53e56926', '3e8a6bfc-06c1-43ba-94b0-e741c9e46f51', '7649baa9-82ec-4d9f-8379-cf8935043a53', '5d79c194-3ea8-465f-a1cf-854d45fa554d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:03 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:03 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:04 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.489s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:04 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:04 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Deleted volume successfully.
Apr 10 10:40:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0629aad6-028c-4463-bcce-8eb09fcb3bbf tempest-SnapshotDependencyTests-451811651 None] Lock "cinder-cf228c42-dd4e-4e90-a889-e0453a46ebb8-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:13 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:40:14 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=4 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (c8614e38-ec14-4094-8e27-6707a1c7e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1197db65-2671-48e0-8f3a-0a11ff1239a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1197db65-2671-48e0-8f3a-0a11ff1239a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-447219241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24433f76-9622-48a7-b8c7-3e302aa9551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408fe74eb6540369fef8216fcbfa98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='a153f7f5a67c4c5a930e938bac386f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520b74e4-f51c-4cb4-b31c-2dde8e4ab6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520b74e4-f51c-4cb4-b31c-2dde8e4ab6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5539b53-6f4b-4660-912c-3318529010dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5539b53-6f4b-4660-912c-3318529010dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24433f76-9622-48a7-b8c7-3e302aa9551f', 'volume_name': 'volume-24433f76-9622-48a7-b8c7-3e302aa9551f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afeea6e-f98d-49ce-a6ae-9a46afc79cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afeea6e-f98d-49ce-a6ae-9a46afc79cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a8a104-5c65-4388-8a0f-ad4e2470cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:16 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Volume 24433f76-9622-48a7-b8c7-3e302aa9551f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24433f76-9622-48a7-b8c7-3e302aa9551f', 'volume_size': 1}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-447219241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24433f76-9622-48a7-b8c7-3e302aa9551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408fe74eb6540369fef8216fcbfa98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='a153f7f5a67c4c5a930e938bac386f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Creating volume 24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:16 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:17 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f 1073741824
Apr 10 10:40:17 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (df4a7e7a-8422-468c-97b7-691035cf9ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5802e190-d1a5-4bb7-81f4-09638f56a191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5802e190-d1a5-4bb7-81f4-09638f56a191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057155924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e30a106-9960-4f67-a9d7-3178ced8f40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7398b0f1-defd-487e-97fb-41d4960981e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7398b0f1-defd-487e-97fb-41d4960981e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc24e02-3bd4-4c3f-93e0-eaf0d99fa101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc24e02-3bd4-4c3f-93e0-eaf0d99fa101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e30a106-9960-4f67-a9d7-3178ced8f40f', 'volume_name': 'volume-7e30a106-9960-4f67-a9d7-3178ced8f40f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a3f462-359d-49c5-bd1b-440e3eb2369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a3f462-359d-49c5-bd1b-440e3eb2369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af7b1d5-4cec-47e5-b9e1-ec9e8aabed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Volume 7e30a106-9960-4f67-a9d7-3178ced8f40f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e30a106-9960-4f67-a9d7-3178ced8f40f', 'volume_size': 1}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (060948cb-4901-4171-a156-d9264c300975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cef2f7-a631-448a-ab2b-966704716661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (010e8032-846b-4f1a-86ea-135aa8727a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f931ec8-e706-44a6-b3e2-ae29de50e879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f931ec8-e706-44a6-b3e2-ae29de50e879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534326651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c526d6d-066e-4a26-bf0a-1dc993ddb5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aeea272-a0d6-43ff-a594-e91e4fddb1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aeea272-a0d6-43ff-a594-e91e4fddb1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af3c292-5f2e-4c43-b9b1-ab5cfa644aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af3c292-5f2e-4c43-b9b1-ab5cfa644aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c526d6d-066e-4a26-bf0a-1dc993ddb5cc', 'volume_name': 'volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab96b85-7173-42a9-bdc1-7160d806890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab96b85-7173-42a9-bdc1-7160d806890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe0a158-977a-44a4-a28c-fb8d3779cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume 9c526d6d-066e-4a26-bf0a-1dc993ddb5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc', 'volume_size': 1}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cef2f7-a631-448a-ab2b-966704716661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515078181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbef7b7-0a4f-4d15-b327-b767c653b9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b2eeab-2c0c-423e-98e3-75b4048d360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b2eeab-2c0c-423e-98e3-75b4048d360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e250d81e-8b12-4c2c-acf4-7cd9040164a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e250d81e-8b12-4c2c-acf4-7cd9040164a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbef7b7-0a4f-4d15-b327-b767c653b9e7', 'volume_name': 'volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35ca8bf-d2fa-4424-a342-69a62a2348d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35ca8bf-d2fa-4424-a342-69a62a2348d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8d8d18-28d7-4642-9c25-afaf7cf0c130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Volume 8dbef7b7-0a4f-4d15-b327-b767c653b9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7', 'volume_size': 1}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (698edc33-634e-45f4-8b39-ed635c8ae060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332b74d7-4653-49f8-9591-45163f1045d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332b74d7-4653-49f8-9591-45163f1045d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061576959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ae649f-f871-463c-9f8d-762a78f2fff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca96b54-c65f-4bf6-b479-e8ec85f79903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca96b54-c65f-4bf6-b479-e8ec85f79903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d2c241-2de5-4d4e-9cd4-1f911bb3e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d2c241-2de5-4d4e-9cd4-1f911bb3e493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ae649f-f871-463c-9f8d-762a78f2fff9', 'volume_name': 'volume-b0ae649f-f871-463c-9f8d-762a78f2fff9', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b4d9db-7825-4202-99bb-75cc7431a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b4d9db-7825-4202-99bb-75cc7431a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e556f193-b415-4b45-9d84-07fbf2e2e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Volume b0ae649f-f871-463c-9f8d-762a78f2fff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ae649f-f871-463c-9f8d-762a78f2fff9', 'volume_size': 1}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (81ae2da2-d1be-422a-a8c0-2fb9fca3ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1115cb-c28a-4e5c-bbc2-e32e7c2fb9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1115cb-c28a-4e5c-bbc2-e32e7c2fb9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-986615822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222dccb8-0a8f-477f-9d89-847f464faf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:18Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a66542-63e5-4fef-b5ba-2cd83bcd3216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a66542-63e5-4fef-b5ba-2cd83bcd3216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bda5be7-ac75-4b89-a8c6-711b1693d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bda5be7-ac75-4b89-a8c6-711b1693d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222dccb8-0a8f-477f-9d89-847f464faf87', 'volume_name': 'volume-222dccb8-0a8f-477f-9d89-847f464faf87', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea06c4ae-6552-4de2-b9f6-5698f87ce6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea06c4ae-6552-4de2-b9f6-5698f87ce6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b0e3d3-097d-465d-99e8-dbdb6630652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Volume 222dccb8-0a8f-477f-9d89-847f464faf87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222dccb8-0a8f-477f-9d89-847f464faf87', 'volume_size': 1}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:17 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f 1073741824" returned: 0 in 0.869s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:17 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f
Apr 10 10:40:17 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (6362e00e-4d3b-4d42-8adc-c3fb8104377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75565f1c-5a39-4eb4-a5fb-888f4cc0ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75565f1c-5a39-4eb4-a5fb-888f4cc0ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087877906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41eedad1-087b-4b18-9c5e-4d854581f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:18Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d3a07a-f4b3-40b8-8ea7-988359460420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d3a07a-f4b3-40b8-8ea7-988359460420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f065bbed-ccdf-4e1e-8ec7-da474cdcb192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f065bbed-ccdf-4e1e-8ec7-da474cdcb192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41eedad1-087b-4b18-9c5e-4d854581f501', 'volume_name': 'volume-41eedad1-087b-4b18-9c5e-4d854581f501', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b341285-3d2b-4c93-95a6-36ec8d1670bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b341285-3d2b-4c93-95a6-36ec8d1670bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7db751-0c48-4f5c-ba31-788fe8fb88c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:18 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Volume 41eedad1-087b-4b18-9c5e-4d854581f501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41eedad1-087b-4b18-9c5e-4d854581f501', 'volume_size': 1}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:18 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f" returned: 0 in 0.416s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057155924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e30a106-9960-4f67-a9d7-3178ced8f40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Creating volume 7e30a106-9960-4f67-a9d7-3178ced8f40f {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:18 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a8a104-5c65-4388-8a0f-ad4e2470cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24433f76-9622-48a7-b8c7-3e302aa9551f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:18 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f 1073741824
Apr 10 10:40:18 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b2f9c6-3f41-4eed-9c30-cc9e3e92565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:18 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Volume volume-24433f76-9622-48a7-b8c7-3e302aa9551f (24433f76-9622-48a7-b8c7-3e302aa9551f): created successfully
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b2f9c6-3f41-4eed-9c30-cc9e3e92565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (c8614e38-ec14-4094-8e27-6707a1c7e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:18 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d42997d8-b156-4bb2-bc84-b843eed7d55a tempest-VolumeDependencyTests-1096015566 None] Created volume successfully.
Apr 10 10:40:18 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f 1073741824" returned: 0 in 0.511s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:18 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f
Apr 10 10:40:18 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:19 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f" returned: 0 in 0.489s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.893s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534326651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c526d6d-066e-4a26-bf0a-1dc993ddb5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Creating volume 9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:19 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af7b1d5-4cec-47e5-b9e1-ec9e8aabed48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e30a106-9960-4f67-a9d7-3178ced8f40f', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b3c14b-a019-4dde-974e-35fd2775d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:19 devstack sudo[88731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc 1073741824
Apr 10 10:40:19 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:19 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Volume volume-7e30a106-9960-4f67-a9d7-3178ced8f40f (7e30a106-9960-4f67-a9d7-3178ced8f40f): created successfully
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b3c14b-a019-4dde-974e-35fd2775d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (df4a7e7a-8422-468c-97b7-691035cf9ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-23787f37-092e-4f55-bf04-d788d3f411bc tempest-CreateVolumesFromImageTest-1065233160 None] Created volume successfully.
Apr 10 10:40:19 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc 1073741824" returned: 0 in 0.566s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:19 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc
Apr 10 10:40:19 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:20 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" returned: 0 in 0.465s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.923s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515078181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbef7b7-0a4f-4d15-b327-b767c653b9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Creating volume 8dbef7b7-0a4f-4d15-b327-b767c653b9e7 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:20 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe0a158-977a-44a4-a28c-fb8d3779cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5917f1bf-2ffc-4de2-b1cb-a06f73964196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:20 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc (9c526d6d-066e-4a26-bf0a-1dc993ddb5cc): created successfully
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5917f1bf-2ffc-4de2-b1cb-a06f73964196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:20 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (010e8032-846b-4f1a-86ea-135aa8727a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:20 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7 1073741824
Apr 10 10:40:20 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:20 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-765ea1dd-2fca-47a6-a7c6-bab336563541 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created volume successfully.
Apr 10 10:40:21 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7 1073741824" returned: 0 in 0.637s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:21 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7
Apr 10 10:40:21 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:21 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7" returned: 0 in 0.563s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.102s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061576959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ae649f-f871-463c-9f8d-762a78f2fff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:17Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Creating volume b0ae649f-f871-463c-9f8d-762a78f2fff9 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:21 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8d8d18-28d7-4642-9c25-afaf7cf0c130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa2c43b-3b87-449d-9cd7-c8d5ce3049b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:21 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9 1073741824
Apr 10 10:40:21 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:21 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Volume volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7 (8dbef7b7-0a4f-4d15-b327-b767c653b9e7): created successfully
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa2c43b-3b87-449d-9cd7-c8d5ce3049b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:21 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (060948cb-4901-4171-a156-d9264c300975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:21 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7f2d2622-8395-4848-805c-eb8c40800414 tempest-CreateVolumesFromImageTest-1065233160 None] Created volume successfully.
Apr 10 10:40:22 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9 1073741824" returned: 0 in 0.620s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:22 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9
Apr 10 10:40:22 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:22 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9" returned: 0 in 0.436s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.934s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-986615822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222dccb8-0a8f-477f-9d89-847f464faf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:18Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Creating volume 222dccb8-0a8f-477f-9d89-847f464faf87 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:22 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e556f193-b415-4b45-9d84-07fbf2e2e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ae649f-f871-463c-9f8d-762a78f2fff9', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311c281a-1a69-467d-bbe7-851829b84393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:22 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Volume volume-b0ae649f-f871-463c-9f8d-762a78f2fff9 (b0ae649f-f871-463c-9f8d-762a78f2fff9): created successfully
Apr 10 10:40:22 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87 1073741824
Apr 10 10:40:22 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311c281a-1a69-467d-bbe7-851829b84393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:22 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (698edc33-634e-45f4-8b39-ed635c8ae060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:22 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d648a129-12f3-4b61-bcf3-cb9bd92b2621 tempest-CreateVolumesFromImageTest-1065233160 None] Created volume successfully.
Apr 10 10:40:23 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87 1073741824" returned: 0 in 0.722s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:23 devstack sudo[88763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87
Apr 10 10:40:23 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:23 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87" returned: 0 in 0.431s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.935s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087877906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41eedad1-087b-4b18-9c5e-4d854581f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b58d4282e44051b9399fedc44588ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:18Z,use_quota=True,user_id='183f5635a2424f4687df17cf6a57076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Creating volume 41eedad1-087b-4b18-9c5e-4d854581f501 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:23 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b0e3d3-097d-465d-99e8-dbdb6630652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222dccb8-0a8f-477f-9d89-847f464faf87', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:23 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501 1073741824
Apr 10 10:40:23 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:23 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af555f7a-3fb5-462e-9a92-95dcf0c0c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:24 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Volume volume-222dccb8-0a8f-477f-9d89-847f464faf87 (222dccb8-0a8f-477f-9d89-847f464faf87): created successfully
Apr 10 10:40:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af555f7a-3fb5-462e-9a92-95dcf0c0c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:24 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (81ae2da2-d1be-422a-a8c0-2fb9fca3ba15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:24 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-2e568053-65aa-48d7-8997-718cdb7c4f0a tempest-CreateVolumesFromImageTest-1065233160 None] Created volume successfully.
Apr 10 10:40:24 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501 1073741824" returned: 0 in 0.567s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:24 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501
Apr 10 10:40:24 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:25 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501" returned: 0 in 0.478s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.878s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7db751-0c48-4f5c-ba31-788fe8fb88c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41eedad1-087b-4b18-9c5e-4d854581f501', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a96895-1d45-4abe-9f5d-6cf94ee46218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:25 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Volume volume-41eedad1-087b-4b18-9c5e-4d854581f501 (41eedad1-087b-4b18-9c5e-4d854581f501): created successfully
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a96895-1d45-4abe-9f5d-6cf94ee46218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Flow 'volume_create_manager' (6362e00e-4d3b-4d42-8adc-c3fb8104377a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Creating offline snapshot 446971bd-fabd-4126-b3b2-f722fbd16187 of volume 24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:40:25 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3193bbec-a11e-4eaf-ad0d-959a1202cf60 tempest-CreateVolumesFromImageTest-1065233160 None] Created volume successfully.
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[571909d0-d3f7-44bb-a2a2-04931c1cd00d]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:25 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f
Apr 10 10:40:25 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-41eedad1-087b-4b18-9c5e-4d854581f501-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-41eedad1-087b-4b18-9c5e-4d854581f501-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-quobyte-41eedad1-087b-4b18-9c5e-4d854581f501" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-41eedad1-087b-4b18-9c5e-4d854581f501" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c2e180-ec5f-4400-8838-63a83e30db27]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:25 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501
Apr 10 10:40:25 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:25 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f" returned: 0 in 0.608s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:25 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 1G
Apr 10 10:40:25 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:26 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501" returned: 0 in 0.543s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:26 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501
Apr 10 10:40:26 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:26 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 1G" returned: 0 in 0.580s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24433f76-9622-48a7-b8c7-3e302aa9551f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:26 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24433f76-9622-48a7-b8c7-3e302aa9551f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187
Apr 10 10:40:26 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:26 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-41eedad1-087b-4b18-9c5e-4d854581f501" returned: 0 in 0.486s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-41eedad1-087b-4b18-9c5e-4d854581f501" released by "delete_volume" :: held 1.075s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Created reservations ['7ce3af2f-8080-4bdc-891c-396b07673726', '98294f67-79dd-4250-8835-bc3c86f98bc3', 'ca250da5-0446-49e7-83b5-e226422ef9f1', 'd27d00ff-f192-49c2-a899-02b548e8d7dc'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:26 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24433f76-9622-48a7-b8c7-3e302aa9551f -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187" returned: 0 in 0.502s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:26 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 is being set with open permissions: ugo+rw
Apr 10 10:40:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:26 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:26 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:26 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187
Apr 10 10:40:26 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:27 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.435s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:27 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Deleted volume successfully.
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-1a9da57e-6e9b-473a-ab1f-216bfd9109de tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-41eedad1-087b-4b18-9c5e-4d854581f501-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:27 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187" returned: 0 in 0.442s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:27 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.info
Apr 10 10:40:27 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-222dccb8-0a8f-477f-9d89-847f464faf87-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:27 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-222dccb8-0a8f-477f-9d89-847f464faf87-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.info" returned: 0 in 0.509s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:27 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.info is being set with open permissions: ugo+rw
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:27 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.info
Apr 10 10:40:27 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-quobyte-222dccb8-0a8f-477f-9d89-847f464faf87" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-222dccb8-0a8f-477f-9d89-847f464faf87" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f81576-42d3-4307-a26c-4b4a36d042ba]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:27 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87
Apr 10 10:40:27 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:28 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.info" returned: 0 in 0.461s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.189s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.595s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Creating offline snapshot 4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 of volume 9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:40:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-26e5d3e3-8ed9-4127-9af1-d28a36205e9e tempest-VolumeDependencyTests-1096015566 None] Create snapshot completed successfully
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b6320-0540-4ae7-80e4-d068555b0c26]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:28 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87" returned: 0 in 0.518s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:28 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc
Apr 10 10:40:28 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:28 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87
Apr 10 10:40:28 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (a8b90e25-8b3f-4dc0-9a86-632cf95110a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c6391e-e9a3-4fc0-9041-71f91fcb543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c6391e-e9a3-4fc0-9041-71f91fcb543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1723276736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e7cf42-1515-4595-bb38-657478c04db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408fe74eb6540369fef8216fcbfa98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=446971bd-fabd-4126-b3b2-f722fbd16187,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:29Z,use_quota=True,user_id='a153f7f5a67c4c5a930e938bac386f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefe69f5-7813-44e1-be20-5a14056faee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefe69f5-7813-44e1-be20-5a14056faee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae94a8f-6335-43e2-abaa-60e8f0d6c4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae94a8f-6335-43e2-abaa-60e8f0d6c4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38e7cf42-1515-4595-bb38-657478c04db7', 'volume_name': 'volume-38e7cf42-1515-4595-bb38-657478c04db7', 'volume_size': 1, 'snapshot_id': '446971bd-fabd-4126-b3b2-f722fbd16187'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1f5550-4569-4c7c-83be-4744c396dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1f5550-4569-4c7c-83be-4744c396dda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:28 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf671b3d-b305-4aae-bca8-319426d57073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:28 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Volume 38e7cf42-1515-4595-bb38-657478c04db7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38e7cf42-1515-4595-bb38-657478c04db7', 'volume_size': 1, 'snapshot_id': '446971bd-fabd-4126-b3b2-f722fbd16187'}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-222dccb8-0a8f-477f-9d89-847f464faf87" returned: 0 in 0.590s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-222dccb8-0a8f-477f-9d89-847f464faf87" released by "delete_volume" :: held 1.134s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:28 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" returned: 0 in 0.678s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:28 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 1G
Apr 10 10:40:28 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:28 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Created reservations ['d6095bd7-497a-408c-8e19-4b30b5e17402', '494b7727-663e-4db0-804b-50f5f9f60375', 'd6a3b649-a9ab-47d9-9d09-6995aae89a30', '9fe8134d-0bd9-4416-a786-be6e6ec5e134'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:29 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:29 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:29 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.464s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:29 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Deleted volume successfully.
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-8aee3e6e-7d86-4564-8cb7-827db62bc6f6 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-222dccb8-0a8f-477f-9d89-847f464faf87-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:29 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 1G" returned: 0 in 0.575s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:29 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592
Apr 10 10:40:29 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-b0ae649f-f871-463c-9f8d-762a78f2fff9-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-b0ae649f-f871-463c-9f8d-762a78f2fff9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:29 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-quobyte-b0ae649f-f871-463c-9f8d-762a78f2fff9" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-b0ae649f-f871-463c-9f8d-762a78f2fff9" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38cf97-fc7d-4ec7-90a2-085b9b8b9423]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:30 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" returned: 0 in 0.534s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:30 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 is being set with open permissions: ugo+rw
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:30 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592
Apr 10 10:40:30 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:30 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9
Apr 10 10:40:30 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:30 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" returned: 0 in 0.508s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:30 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.info
Apr 10 10:40:30 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:30 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9" returned: 0 in 0.607s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:30 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:30 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9
Apr 10 10:40:30 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Flow 'volume_create_manager' (72e6826d-8e04-4199-ad6b-4cfd42b15f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363f1ca0-84a4-4390-87be-f39cb0b13769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363f1ca0-84a4-4390-87be-f39cb0b13769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1172972905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97608e0e-d37e-4882-ac3f-48dcd56f90fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f0c96974464ca7884015a656be69d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:31Z,use_quota=True,user_id='661e5f3041f7408883151dd633ebda19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc54b33e-9ad5-4ac3-814a-6ccdbe7b6355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc54b33e-9ad5-4ac3-814a-6ccdbe7b6355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d48b49-0690-4f29-84ab-76107b3c0951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d48b49-0690-4f29-84ab-76107b3c0951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97608e0e-d37e-4882-ac3f-48dcd56f90fc', 'volume_name': 'volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f681afe-287f-4d76-9aea-468cce9e7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f681afe-287f-4d76-9aea-468cce9e7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31323807-376c-401c-8c88-01ccd5e675e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:31 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Volume 97608e0e-d37e-4882-ac3f-48dcd56f90fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc', 'volume_size': 1}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:31 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.info" returned: 0 in 0.523s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:31 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.info is being set with open permissions: ugo+rw
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:31 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.info
Apr 10 10:40:31 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:31 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b0ae649f-f871-463c-9f8d-762a78f2fff9" returned: 0 in 0.517s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-b0ae649f-f871-463c-9f8d-762a78f2fff9" released by "delete_volume" :: held 1.149s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Created reservations ['b31aa548-4aa2-4145-b252-d783587c0317', '6e07ad1c-8618-46c1-8a50-e8fdba11bd3f', '7e6103bd-db14-46e3-b846-e5b43772175a', 'cc5d0f7f-1595-4693-9783-deb3b0932785'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:31 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:31 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:31 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.info" returned: 0 in 0.430s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.330s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.630s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-446971bd-fabd-4126-b3b2-f722fbd16187-38e7cf42-1515-4595-bb38-657478c04db7" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d8ef4996-fba8-4d9d-8a58-06cafcb01471 tempest-CreateVolumesFromSnapshotTest-152954993 None] Create snapshot completed successfully
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-446971bd-fabd-4126-b3b2-f722fbd16187-38e7cf42-1515-4595-bb38-657478c04db7" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Creating volume 38e7cf42-1515-4595-bb38-657478c04db7 from snapshot 446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-38e7cf42-1515-4595-bb38-657478c04db7" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-38e7cf42-1515-4595-bb38-657478c04db7" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] snapshot: 446971bd-fabd-4126-b3b2-f722fbd16187, volume: 38e7cf42-1515-4595-bb38-657478c04db7,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8846a8-442f-40a2-a5e3-8774702652cb]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:31 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.415s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:31 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Deleted volume successfully.
Apr 10 10:40:31 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-7f5078a3-a6a1-4f65-adb2-c15cc38cca1e tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-b0ae649f-f871-463c-9f8d-762a78f2fff9-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:31 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187
Apr 10 10:40:31 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:32 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187" returned: 0 in 0.493s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24433f76-9622-48a7-b8c7-3e302aa9551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fafaa7-94ce-43cb-9bf0-13854d1322eb]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-8dbef7b7-0a4f-4d15-b327-b767c653b9e7-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-8dbef7b7-0a4f-4d15-b327-b767c653b9e7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:32 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f
Apr 10 10:40:32 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-quobyte-8dbef7b7-0a4f-4d15-b327-b767c653b9e7" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-8dbef7b7-0a4f-4d15-b327-b767c653b9e7" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[865dade4-4449-4ba0-8ff0-7e9e9f07e383]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (89b87137-d0ab-4462-a2a9-81a721dbb6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f686283-bb63-401e-8139-f02262cff53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7
Apr 10 10:40:32 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f686283-bb63-401e-8139-f02262cff53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1343446628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:32Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aeb641-0c5a-4e51-a46b-608922d24e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aeb641-0c5a-4e51-a46b-608922d24e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14eef5d-200d-419d-89c6-116f1a1b4fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14eef5d-200d-419d-89c6-116f1a1b4fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea', 'volume_name': 'volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1153ae64-f86c-41fb-a44f-d7c9dbdd470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1153ae64-f86c-41fb-a44f-d7c9dbdd470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbfc1e1-1880-44da-9859-b26eecd6c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume 4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea', 'volume_size': 1}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (5802eac1-a25c-447b-9759-28e076462d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09d3634-3e84-4728-ab40-bdd7fb1802c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09d3634-3e84-4728-ab40-bdd7fb1802c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690865995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52521027-b929-4b8a-ac69-22070eea4c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f98fd9-0dda-4f2b-8500-daf1b58036ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f98fd9-0dda-4f2b-8500-daf1b58036ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6014ff-fc87-4d1f-a41c-07c424e54271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6014ff-fc87-4d1f-a41c-07c424e54271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52521027-b929-4b8a-ac69-22070eea4c17', 'volume_name': 'volume-52521027-b929-4b8a-ac69-22070eea4c17', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8433d3fb-6c57-4beb-9bec-e865d217d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8433d3fb-6c57-4beb-9bec-e865d217d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c092701-3c99-4648-9b3f-2e07e7254f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume 52521027-b929-4b8a-ac69-22070eea4c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52521027-b929-4b8a-ac69-22070eea4c17', 'volume_size': 1}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (9e8ac077-d2c3-4fc8-ad37-2c74413f094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:32 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69beeb68-9050-4190-abad-0c0b5b22a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f" returned: 0 in 0.707s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:32 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7
Apr 10 10:40:32 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69beeb68-9050-4190-abad-0c0b5b22a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017103742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a26cfc-157c-45fc-a263-a7d2713bda79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b7d6f9-513f-4566-9cd3-2cdf63b86ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b7d6f9-513f-4566-9cd3-2cdf63b86ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9a5f01-ebc5-4f71-b26b-5b8841babafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9a5f01-ebc5-4f71-b26b-5b8841babafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a26cfc-157c-45fc-a263-a7d2713bda79', 'volume_name': 'volume-e1a26cfc-157c-45fc-a263-a7d2713bda79', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f372326a-ec35-4e37-8602-977f29971e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f372326a-ec35-4e37-8602-977f29971e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5709c7-c5b4-4c19-9dcf-6a1c55ee9530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:32 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume e1a26cfc-157c-45fc-a263-a7d2713bda79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a26cfc-157c-45fc-a263-a7d2713bda79', 'volume_size': 1}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:32 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7" returned: 0 in 0.681s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:32 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:32 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7
Apr 10 10:40:32 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (1b3f2f67-9e01-4bb7-bd07-5680c7c79178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea25dd1-c27f-4a06-b78b-ae2e5708f6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea25dd1-c27f-4a06-b78b-ae2e5708f6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327352611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf38118-105e-4ced-a89e-3c9437910411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8559de8c-bcab-45fa-8968-c4d90d5b983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8559de8c-bcab-45fa-8968-c4d90d5b983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fffcbf-7057-4b81-8d51-ad85241ba57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fffcbf-7057-4b81-8d51-ad85241ba57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf38118-105e-4ced-a89e-3c9437910411', 'volume_name': 'volume-acf38118-105e-4ced-a89e-3c9437910411', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4dc463-4c19-43c2-832a-b9b2fcc88663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4dc463-4c19-43c2-832a-b9b2fcc88663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc3f72c-1a0b-430f-b82d-26eb89268e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume acf38118-105e-4ced-a89e-3c9437910411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf38118-105e-4ced-a89e-3c9437910411', 'volume_size': 1}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (c84d90ae-290a-4568-851a-9c07f04ad1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340e317b-00a2-49d1-a6a3-59053e0ebb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340e317b-00a2-49d1-a6a3-59053e0ebb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692345872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b836e053-096a-40f1-8726-1f5ef9fa1092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2c3b33-e769-4db9-a342-ed4645c5db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2c3b33-e769-4db9-a342-ed4645c5db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea98e8e-ba16-4ca0-ae9b-a4a28289d5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea98e8e-ba16-4ca0-ae9b-a4a28289d5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b836e053-096a-40f1-8726-1f5ef9fa1092', 'volume_name': 'volume-b836e053-096a-40f1-8726-1f5ef9fa1092', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f04b7e-800c-4d36-acc3-d1c16bff644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f04b7e-800c-4d36-acc3-d1c16bff644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d06be3-b3ab-4380-93a3-399b08a3bced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:33 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume b836e053-096a-40f1-8726-1f5ef9fa1092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b836e053-096a-40f1-8726-1f5ef9fa1092', 'volume_size': 1}
Apr 10 10:40:33 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:34 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-8dbef7b7-0a4f-4d15-b327-b767c653b9e7" returned: 0 in 1.076s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-8dbef7b7-0a4f-4d15-b327-b767c653b9e7" released by "delete_volume" :: held 1.791s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Created reservations ['37cae04e-97a1-4efd-8478-6c5c0a23d3ee', '815bbe35-ca27-4b9b-8d63-a1df8e19732a', '38434788-0fe4-4545-ba75-47eb4445227b', 'e5d08e81-430f-4716-b8c8-60ee5b32d16b'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:34 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:34 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-7e30a106-9960-4f67-a9d7-3178ced8f40f-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-7e30a106-9960-4f67-a9d7-3178ced8f40f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "cinder-quobyte-7e30a106-9960-4f67-a9d7-3178ced8f40f" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-7e30a106-9960-4f67-a9d7-3178ced8f40f" acquired by "delete_volume" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba417b9a-6f3a-4b2a-b078-b7339cabea2b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:34 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:35 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f
Apr 10 10:40:35 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:35 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7" returned: 0 in 2.275s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f604c2c5-0ce7-4312-be37-0d4feb80d464]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:35 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f
Apr 10 10:40:35 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:35 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 1.078s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:35 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Deleted volume successfully.
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6a7f3568-ecd1-41b8-9474-2f7c3cca033c tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-8dbef7b7-0a4f-4d15-b327-b767c653b9e7-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:35 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f" returned: 0 in 0.712s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:35 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f
Apr 10 10:40:35 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:35 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f" returned: 0 in 0.663s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:40:35 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Converted 1024.00 MB image at 449.90 MB/s
Apr 10 10:40:35 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7 is being set with open permissions: ugo+rw
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:35 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7
Apr 10 10:40:35 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:35 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-7e30a106-9960-4f67-a9d7-3178ced8f40f" returned: 0 in 0.439s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-quobyte-7e30a106-9960-4f67-a9d7-3178ced8f40f" released by "delete_volume" :: held 1.189s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Created reservations ['58d6e39c-a209-4682-a526-0b6d269d3ebf', 'eabe3922-607f-43f8-94f3-ee8dd57fae3f', '632cad26-18a1-470f-8420-6c10bf87d2b9', '0066c590-2524-4bc8-9666-1782beae53e9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:35 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:36 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:36 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:36 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7" returned: 0 in 0.420s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-38e7cf42-1515-4595-bb38-657478c04db7" released by "_copy_volume_from_snapshot" :: held 4.619s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-446971bd-fabd-4126-b3b2-f722fbd16187-38e7cf42-1515-4595-bb38-657478c04db7" released by "_create_volume_from_snapshot" :: held 4.637s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.655s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.156s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1172972905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97608e0e-d37e-4882-ac3f-48dcd56f90fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f0c96974464ca7884015a656be69d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:31Z,use_quota=True,user_id='661e5f3041f7408883151dd633ebda19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Creating volume 97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:36 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:36 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc 1073741824
Apr 10 10:40:36 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf671b3d-b305-4aae-bca8-319426d57073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e7cf42-1515-4595-bb38-657478c04db7', 'volume_size': 1, 'snapshot_id': '446971bd-fabd-4126-b3b2-f722fbd16187'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20382480-d4a6-4c3f-b88f-6cb235c8c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:36 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Volume volume-38e7cf42-1515-4595-bb38-657478c04db7 (38e7cf42-1515-4595-bb38-657478c04db7): created successfully
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20382480-d4a6-4c3f-b88f-6cb235c8c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (a8b90e25-8b3f-4dc0-9a86-632cf95110a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-96c1b47b-e693-43b5-b0b0-ca2cb475dbb0 tempest-VolumeDependencyTests-1096015566 None] Created volume successfully.
Apr 10 10:40:36 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.454s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:36 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Deleted volume successfully.
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-3c1f90f7-28ca-4434-870a-175f08ae80d5 tempest-CreateVolumesFromImageTest-1065233160 None] Lock "cinder-7e30a106-9960-4f67-a9d7-3178ced8f40f-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:36 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc 1073741824" returned: 0 in 0.541s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:36 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:36 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc
Apr 10 10:40:36 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:37 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc" returned: 0 in 0.439s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.878s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1343446628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:32Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Creating volume 4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:37 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31323807-376c-401c-8c88-01ccd5e675e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f30ca1-f55b-41e4-bf37-14e9b42e4f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:37 devstack sudo[88920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea 1073741824
Apr 10 10:40:37 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:37 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Volume volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc (97608e0e-d37e-4882-ac3f-48dcd56f90fc): created successfully
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f30ca1-f55b-41e4-bf37-14e9b42e4f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Flow 'volume_create_manager' (72e6826d-8e04-4199-ad6b-4cfd42b15f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:37 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-0d5db908-072b-4a66-a3ff-0a95e05369b0 tempest-SnapshotDependencyTests-1865100927 None] Created volume successfully.
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-446971bd-fabd-4126-b3b2-f722fbd16187-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-446971bd-fabd-4126-b3b2-f722fbd16187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-24433f76-9622-48a7-b8c7-3e302aa9551f" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-24433f76-9622-48a7-b8c7-3e302aa9551f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-446971bd-fabd-4126-b3b2-f722fbd16187" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:37 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:37 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-446971bd-fabd-4126-b3b2-f722fbd16187" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Deleting offline snapshot 446971bd-fabd-4126-b3b2-f722fbd16187 of volume 24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] snapshot_file for this snap is: volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63fef34-4e1a-4339-92da-b17638649139]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:37 devstack sudo[88924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187
Apr 10 10:40:37 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:37 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea 1073741824" returned: 0 in 0.741s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:38 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea
Apr 10 10:40:38 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:38 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.641s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:38 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187" returned: 0 in 0.717s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24433f76-9622-48a7-b8c7-3e302aa9551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3aae3-036c-41be-8703-ebc243b56ae3]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:38 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f
Apr 10 10:40:38 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:38 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea" returned: 0 in 0.487s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.815s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690865995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52521027-b929-4b8a-ac69-22070eea4c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Creating volume 52521027-b929-4b8a-ac69-22070eea4c17 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:38 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbfc1e1-1880-44da-9859-b26eecd6c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fb79f8-66ae-42ca-b844-8fdc9e925dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:38 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17 1073741824
Apr 10 10:40:38 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:38 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea (4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea): created successfully
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fb79f8-66ae-42ca-b844-8fdc9e925dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (89b87137-d0ab-4462-a2a9-81a721dbb6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:38 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-df12290c-4693-4519-aaa8-6c0fbcb3a4ba tempest-CreateVolumesFromSnapshotTest-152954993 None] Created volume successfully.
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (a843adb1-2827-4495-95e2-12dd0a2f5495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cf209f-2903-4b81-9ede-88681ed13552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cf209f-2903-4b81-9ede-88681ed13552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210741019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fda0ff-319f-4418-a7da-bb667bb9de21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:39Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8107a033-b61e-475c-9c8f-6d640ab0743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8107a033-b61e-475c-9c8f-6d640ab0743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5b3482-5c02-4222-9845-e1d7abf81b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5b3482-5c02-4222-9845-e1d7abf81b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fda0ff-319f-4418-a7da-bb667bb9de21', 'volume_name': 'volume-10fda0ff-319f-4418-a7da-bb667bb9de21', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:38 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5371e671-cb8a-4b88-b756-cecbfd10f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5371e671-cb8a-4b88-b756-cecbfd10f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd2cba2-696c-4791-bb27-469c55681b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:38 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume 10fda0ff-319f-4418-a7da-bb667bb9de21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fda0ff-319f-4418-a7da-bb667bb9de21', 'volume_size': 1}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f" returned: 0 in 0.665s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:38 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:38 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187
Apr 10 10:40:38 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:39 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17 1073741824" returned: 0 in 0.724s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:39 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17
Apr 10 10:40:39 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:39 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187" returned: 0 in 0.573s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:39 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187
Apr 10 10:40:39 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:39 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17" returned: 0 in 0.589s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.965s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017103742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a26cfc-157c-45fc-a263-a7d2713bda79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Creating volume e1a26cfc-157c-45fc-a263-a7d2713bda79 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:39 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c092701-3c99-4648-9b3f-2e07e7254f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52521027-b929-4b8a-ac69-22070eea4c17', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:39 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79 1073741824
Apr 10 10:40:39 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ae133-e71e-475f-87ac-55e5f8637326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:39 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume volume-52521027-b929-4b8a-ac69-22070eea4c17 (52521027-b929-4b8a-ac69-22070eea4c17): created successfully
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ae133-e71e-475f-87ac-55e5f8637326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (5802eac1-a25c-447b-9759-28e076462d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:39 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-b0ee9f3f-384c-4fdf-ad81-840b7aa3ec81 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created volume successfully.
Apr 10 10:40:39 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:39 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f.446971bd-fabd-4126-b3b2-f722fbd16187" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-446971bd-fabd-4126-b3b2-f722fbd16187" released by "_delete_snapshot" :: held 2.529s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-24433f76-9622-48a7-b8c7-3e302aa9551f" released by "delete_snapshot" :: held 2.552s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Created reservations ['f99f9f08-c4ad-471d-a37f-eb300315f872', '04635016-7c51-4b18-9d84-421abc36c1ae', '6ff4a9af-098a-4dbc-9502-4a6b64807cb4', '1404b0ff-336b-4e94-8b8b-8ac7be953ee6'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:40 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Delete snapshot completed successfully.
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e97acb69-4f59-4da0-a1c2-68cfa3aa2f5b tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-446971bd-fabd-4126-b3b2-f722fbd16187-delete_snapshot" released by "delete_snapshot" :: held 2.663s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:40 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79 1073741824" returned: 0 in 0.607s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:40 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79
Apr 10 10:40:40 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-24433f76-9622-48a7-b8c7-3e302aa9551f-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-24433f76-9622-48a7-b8c7-3e302aa9551f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-24433f76-9622-48a7-b8c7-3e302aa9551f" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-24433f76-9622-48a7-b8c7-3e302aa9551f" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[883a35e7-6c9e-4b08-957e-e1e42ef37fb2]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:40 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f
Apr 10 10:40:40 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:40 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79" returned: 0 in 0.471s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.746s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327352611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf38118-105e-4ced-a89e-3c9437910411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Creating volume acf38118-105e-4ced-a89e-3c9437910411 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:40 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:41 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5709c7-c5b4-4c19-9dcf-6a1c55ee9530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a26cfc-157c-45fc-a263-a7d2713bda79', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:41 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411 1073741824
Apr 10 10:40:41 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df11eb75-4b93-460c-9310-acf47822fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:41 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume volume-e1a26cfc-157c-45fc-a263-a7d2713bda79 (e1a26cfc-157c-45fc-a263-a7d2713bda79): created successfully
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df11eb75-4b93-460c-9310-acf47822fef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (9e8ac077-d2c3-4fc8-ad37-2c74413f094e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:41 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4cdc9cc3-5340-4edb-8e35-10689f27070f tempest-CreateVolumesFromSnapshotTest-152954993 None] Created volume successfully.
Apr 10 10:40:41 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f" returned: 0 in 0.504s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:41 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f
Apr 10 10:40:41 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:41 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-24433f76-9622-48a7-b8c7-3e302aa9551f" returned: 0 in 0.449s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:41 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411 1073741824" returned: 0 in 0.641s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-24433f76-9622-48a7-b8c7-3e302aa9551f" released by "delete_volume" :: held 1.007s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:41 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411
Apr 10 10:40:41 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Created reservations ['8338f8bb-1522-45d0-a5c0-6429bdef26db', 'f30b1e0d-34d3-437a-b32a-8c79a92d58ff', '98200fd7-1811-44d4-9293-862446bd8fca', '1303c468-b4ee-43d3-b942-9468f7e3b4b0'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:41 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:41 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:41 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:42 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411" returned: 0 in 0.465s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.348s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692345872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b836e053-096a-40f1-8726-1f5ef9fa1092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fae7349974822b91a174b07a2eccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:33Z,use_quota=True,user_id='2428af19b58542f6bec0d987dfa33fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Creating volume b836e053-096a-40f1-8726-1f5ef9fa1092 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:42 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:42 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092 1073741824
Apr 10 10:40:42 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:42 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc3f72c-1a0b-430f-b82d-26eb89268e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf38118-105e-4ced-a89e-3c9437910411', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b06632-a3cb-4f23-9720-436e70c72955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.439s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:42 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Deleted volume successfully.
Apr 10 10:40:42 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume volume-acf38118-105e-4ced-a89e-3c9437910411 (acf38118-105e-4ced-a89e-3c9437910411): created successfully
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b06632-a3cb-4f23-9720-436e70c72955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (1b3f2f67-9e01-4bb7-bd07-5680c7c79178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:42 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e4e3a2d1-e02a-4ec8-a072-38450a3f49fc tempest-CreateVolumesFromSnapshotTest-152954993 None] Created volume successfully.
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-86a3341f-94e7-472f-8816-e5737b448024 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-24433f76-9622-48a7-b8c7-3e302aa9551f-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:42 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092 1073741824" returned: 0 in 0.521s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:42 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:42 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092
Apr 10 10:40:42 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (018b0c84-3f90-44b2-9e7b-851110350b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa833c2-6c62-41e3-b296-db37e13963ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa833c2-6c62-41e3-b296-db37e13963ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2050384182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408fe74eb6540369fef8216fcbfa98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:43Z,use_quota=True,user_id='a153f7f5a67c4c5a930e938bac386f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d11119-b124-45e5-a312-3fa3ae837e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d11119-b124-45e5-a312-3fa3ae837e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b468fa91-e0a8-4a03-a015-78d7ec7df090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b468fa91-e0a8-4a03-a015-78d7ec7df090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd892b4a0-bf47-42fa-a1b2-0b87e95d1e7c', 'volume_name': 'volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356e2e45-e995-4832-bed8-afbf489704ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356e2e45-e995-4832-bed8-afbf489704ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99492304-b80e-4300-9105-633986b61c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:43 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Volume d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c', 'volume_size': 1}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:43 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092" returned: 0 in 0.455s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.415s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d06be3-b3ab-4380-93a3-399b08a3bced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b836e053-096a-40f1-8726-1f5ef9fa1092', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abeac412-f501-44cf-b959-74768e51cecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Creating offline snapshot 036784fc-fc20-4e50-828b-00f755ba9b22 of volume 97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:40:43 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Volume volume-b836e053-096a-40f1-8726-1f5ef9fa1092 (b836e053-096a-40f1-8726-1f5ef9fa1092): created successfully
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abeac412-f501-44cf-b959-74768e51cecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Flow 'volume_create_manager' (c84d90ae-290a-4568-851a-9c07f04ad1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46fe73a-b490-4b05-9df4-9d4f4cea967f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:43 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-9fa771d4-9158-4c4d-864c-967f44a008c5 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created volume successfully.
Apr 10 10:40:43 devstack sudo[88993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc
Apr 10 10:40:43 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-b836e053-096a-40f1-8726-1f5ef9fa1092-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-b836e053-096a-40f1-8726-1f5ef9fa1092-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-b836e053-096a-40f1-8726-1f5ef9fa1092" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-b836e053-096a-40f1-8726-1f5ef9fa1092" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5baf0c-29f2-4289-8d8b-7a8246eabed6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:43 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092
Apr 10 10:40:43 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:43 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc" returned: 0 in 0.505s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:43 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 1G
Apr 10 10:40:43 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:43 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092" returned: 0 in 0.482s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:43 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:43 devstack sudo[89005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092
Apr 10 10:40:43 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:44 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 1G" returned: 0 in 0.527s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:44 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22
Apr 10 10:40:44 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:44 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-b836e053-096a-40f1-8726-1f5ef9fa1092" returned: 0 in 0.444s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-b836e053-096a-40f1-8726-1f5ef9fa1092" released by "delete_volume" :: held 0.961s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Created reservations ['18b97250-a14b-4b42-81b6-7866a4eeb954', 'acfd3cc9-82af-4a77-b221-059b1b3b70b4', '87beac1d-23ff-49a1-a371-82220788f9c8', '9be8b61f-d25c-46c2-852b-1e298cf351c5'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:44 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:44 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-acf38118-105e-4ced-a89e-3c9437910411-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-acf38118-105e-4ced-a89e-3c9437910411-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-acf38118-105e-4ced-a89e-3c9437910411" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-acf38118-105e-4ced-a89e-3c9437910411" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a677273-6735-485f-904e-cda8a80139e2]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:44 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411
Apr 10 10:40:44 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:44 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22" returned: 0 in 0.499s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:44 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 is being set with open permissions: ugo+rw
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:44 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22
Apr 10 10:40:44 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:44 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.437s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:44 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Deleted volume successfully.
Apr 10 10:40:44 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-37f07bdb-98e1-41eb-abb8-3aff1e9f957f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-b836e053-096a-40f1-8726-1f5ef9fa1092-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:45 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411" returned: 0 in 0.591s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:45 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411
Apr 10 10:40:45 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:45 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22" returned: 0 in 0.443s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:45 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.info
Apr 10 10:40:45 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:45 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-acf38118-105e-4ced-a89e-3c9437910411" returned: 0 in 0.444s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-acf38118-105e-4ced-a89e-3c9437910411" released by "delete_volume" :: held 1.058s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created reservations ['3f99fff7-964b-4064-886c-3864b673a0db', 'b3d237e0-1cff-44f8-833a-fdbf1d257138', '66d0b05d-d9c2-4d92-9cba-c321b49377fd', '778b8c9d-3b37-40dd-9c10-a6a5e8b59cd1'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:45 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.info" returned: 0 in 0.492s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:45 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.info is being set with open permissions: ugo+rw
Apr 10 10:40:45 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:45 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:45 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:45 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.info
Apr 10 10:40:45 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:46 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.411s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Deleted volume successfully.
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-82c06dba-0c34-46ee-8ad6-24612af58c59 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-acf38118-105e-4ced-a89e-3c9437910411-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:46 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.info" returned: 0 in 0.512s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.358s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210741019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fda0ff-319f-4418-a7da-bb667bb9de21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:39Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Creating volume 10fda0ff-319f-4418-a7da-bb667bb9de21 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:46 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:46 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21 1073741824
Apr 10 10:40:46 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:46 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-8353a988-ceed-4b8a-ac05-ade530e32d48 tempest-SnapshotDependencyTests-1865100927 None] Create snapshot completed successfully
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-e1a26cfc-157c-45fc-a263-a7d2713bda79-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-e1a26cfc-157c-45fc-a263-a7d2713bda79-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-e1a26cfc-157c-45fc-a263-a7d2713bda79" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-e1a26cfc-157c-45fc-a263-a7d2713bda79" acquired by "delete_volume" :: waited 0.021s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d835e23e-a9ae-417e-8633-54f6e32b89be]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:46 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21 1073741824" returned: 0 in 0.526s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:46 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:46 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21
Apr 10 10:40:46 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:46 devstack sudo[89045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79
Apr 10 10:40:46 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:47 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21" returned: 0 in 0.469s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.153s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2050384182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408fe74eb6540369fef8216fcbfa98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:43Z,use_quota=True,user_id='a153f7f5a67c4c5a930e938bac386f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Creating volume d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:47 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:47 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79" returned: 0 in 0.562s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:47 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c 1073741824
Apr 10 10:40:47 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd2cba2-696c-4791-bb27-469c55681b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fda0ff-319f-4418-a7da-bb667bb9de21', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2ed461-46fd-42cf-9b95-abd346ebbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:47 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79
Apr 10 10:40:47 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:47 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume volume-10fda0ff-319f-4418-a7da-bb667bb9de21 (10fda0ff-319f-4418-a7da-bb667bb9de21): created successfully
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2ed461-46fd-42cf-9b95-abd346ebbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (a843adb1-2827-4495-95e2-12dd0a2f5495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:47 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d0deb2a3-33ba-42e0-944c-7a338b7f7faa tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created volume successfully.
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Flow 'volume_create_manager' (ae355a22-cea2-4c20-ac92-e0d1a7471581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4655dac3-f23d-48f1-bd01-7284f15d46e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4655dac3-f23d-48f1-bd01-7284f15d46e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f8a0e2-9437-4290-a97a-5619ea0bc3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f0c96974464ca7884015a656be69d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=036784fc-fc20-4e50-828b-00f755ba9b22,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:47Z,use_quota=True,user_id='661e5f3041f7408883151dd633ebda19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba67028-ad25-46d8-a8a9-ce0a572f30f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba67028-ad25-46d8-a8a9-ce0a572f30f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f6d26c-ae90-4f78-a5f0-82ff133d2ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f6d26c-ae90-4f78-a5f0-82ff133d2ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22f8a0e2-9437-4290-a97a-5619ea0bc3f9', 'volume_name': 'volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9', 'volume_size': 1, 'snapshot_id': '036784fc-fc20-4e50-828b-00f755ba9b22'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f5e04a-7058-452b-b9ea-b8463b43d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f5e04a-7058-452b-b9ea-b8463b43d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b722b48b-b892-469e-818a-b6b68c2e8fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:47 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Volume 22f8a0e2-9437-4290-a97a-5619ea0bc3f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9', 'volume_size': 1, 'snapshot_id': '036784fc-fc20-4e50-828b-00f755ba9b22'}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:47 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e1a26cfc-157c-45fc-a263-a7d2713bda79" returned: 0 in 0.472s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-e1a26cfc-157c-45fc-a263-a7d2713bda79" released by "delete_volume" :: held 1.066s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:47 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c 1073741824" returned: 0 in 0.538s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Created reservations ['d30975de-14f7-47d9-88bb-40470d9b5eed', 'ecdff727-31d1-4e68-b4f8-e1e5d36b0c64', '716b997d-701d-49b3-a5d6-9e10b49c6566', '6066e9af-cb9f-47d1-b0ce-62846f0501f7'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:47 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c
Apr 10 10:40:47 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:47 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:47 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:47 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:48 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" returned: 0 in 0.449s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.855s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-quobyte-036784fc-fc20-4e50-828b-00f755ba9b22-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" by "_create_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-036784fc-fc20-4e50-828b-00f755ba9b22-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Creating volume 22f8a0e2-9437-4290-a97a-5619ea0bc3f9 from snapshot 036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-quobyte-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99492304-b80e-4300-9105-633986b61c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1810025a-eb4a-435f-8a47-7936db5a4074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] snapshot: 036784fc-fc20-4e50-828b-00f755ba9b22, volume: 22f8a0e2-9437-4290-a97a-5619ea0bc3f9,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:40:48 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Volume volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c (d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c): created successfully
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1810025a-eb4a-435f-8a47-7936db5a4074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (018b0c84-3f90-44b2-9e7b-851110350b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:48 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.490s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062e328-66f4-4a12-a0db-8bf0691abc02]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Deleted volume successfully.
Apr 10 10:40:48 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-089051d6-7ce2-4c95-a41c-6272fcd226f5 tempest-VolumeDependencyTests-1096015566 None] Created volume successfully.
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-405d2232-8a44-47f9-966f-5148c37bc59f tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-e1a26cfc-157c-45fc-a263-a7d2713bda79-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:48 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22
Apr 10 10:40:48 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (8d2647e1-b36d-4df9-9a5a-cf04f5b999a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325b3fff-dc64-42c1-9dcd-8de3f72c3cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325b3fff-dc64-42c1-9dcd-8de3f72c3cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-492297596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95b6b32-ffbf-45ab-81c6-fd98a37f66fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b7c45f-6cd6-46ee-9f44-d25c34e10434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b7c45f-6cd6-46ee-9f44-d25c34e10434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1477478-6bb5-4d7e-8edf-cafa62a2f67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1477478-6bb5-4d7e-8edf-cafa62a2f67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95b6b32-ffbf-45ab-81c6-fd98a37f66fd', 'volume_name': 'volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262b2099-9777-47c7-a32b-044869ae4158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262b2099-9777-47c7-a32b-044869ae4158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d30c105-98f9-4616-b80b-b0c1cb18c085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume c95b6b32-ffbf-45ab-81c6-fd98a37f66fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd', 'volume_size': 1}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (3fec550f-4164-4ca0-b4a5-fe719c5fdfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15e3fc4-8232-4782-b2cf-70cfe823136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15e3fc4-8232-4782-b2cf-70cfe823136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208892438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6459838a-e904-4507-bfbd-728e84060c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6459838a-e904-4507-bfbd-728e84060c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4e9d62-4cb0-412a-86f8-88d59b199115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4e9d62-4cb0-412a-86f8-88d59b199115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07', 'volume_name': 'volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bba4a8-ffb0-464e-a15b-6b535cfa1852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bba4a8-ffb0-464e-a15b-6b535cfa1852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537abe54-85e0-42df-92d4-fa7466de0256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:48 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07', 'volume_size': 1}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-52521027-b929-4b8a-ac69-22070eea4c17-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-52521027-b929-4b8a-ac69-22070eea4c17-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-52521027-b929-4b8a-ac69-22070eea4c17" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-52521027-b929-4b8a-ac69-22070eea4c17" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[9609cb9e-98ee-4505-9673-9ec2d4091281]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:48 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:49 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17
Apr 10 10:40:49 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (c7c7b867-4b3e-418d-b0c7-d3514cf6a200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba17560-7719-4625-b45d-46d6d8044668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba17560-7719-4625-b45d-46d6d8044668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1981125669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707c41f0-a17b-4c5b-ba19-c2b868c20507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c039ae3-5977-4212-9bbb-b4a6428a5311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c039ae3-5977-4212-9bbb-b4a6428a5311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab08dab-feff-40d1-9e89-32dd1bda318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab08dab-feff-40d1-9e89-32dd1bda318e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707c41f0-a17b-4c5b-ba19-c2b868c20507', 'volume_name': 'volume-707c41f0-a17b-4c5b-ba19-c2b868c20507', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59d0716-c575-4406-a943-a1a373424764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59d0716-c575-4406-a943-a1a373424764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6348d4a-d45c-483a-9df6-d16bfdfa9e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume 707c41f0-a17b-4c5b-ba19-c2b868c20507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707c41f0-a17b-4c5b-ba19-c2b868c20507', 'volume_size': 1}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:49 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22" returned: 0 in 0.703s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd6e14-a280-450b-8d71-80017622fc26]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:49 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc
Apr 10 10:40:49 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (0475ad0f-38a4-443a-8ca1-2a3ecf1dfa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f611167f-7124-4217-b263-49b0202ec6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f611167f-7124-4217-b263-49b0202ec6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988661090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3507b85c-e46e-4b5f-af51-fce816c79563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a3a866-d889-40c1-a6e7-396ddeccb3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a3a866-d889-40c1-a6e7-396ddeccb3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32479f2-eb7d-40f6-be9e-f0e4b19ffbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32479f2-eb7d-40f6-be9e-f0e4b19ffbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3507b85c-e46e-4b5f-af51-fce816c79563', 'volume_name': 'volume-3507b85c-e46e-4b5f-af51-fce816c79563', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88741bf-d657-401e-a362-9353bea5ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88741bf-d657-401e-a362-9353bea5ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee6a01d-ba80-4744-8d82-b4e9d6ed6c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume 3507b85c-e46e-4b5f-af51-fce816c79563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3507b85c-e46e-4b5f-af51-fce816c79563', 'volume_size': 1}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (081cbcf0-63aa-4b99-bf21-106539413c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f46251-5864-4cb0-aa33-54dbeedb60f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f46251-5864-4cb0-aa33-54dbeedb60f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1054382064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22ae147-ba31-4f0b-8f05-085303f63723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:50Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4646b1-2881-43f7-a53b-d24450100c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4646b1-2881-43f7-a53b-d24450100c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa32a433-acfa-4a58-80c9-6d4997ae0db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa32a433-acfa-4a58-80c9-6d4997ae0db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22ae147-ba31-4f0b-8f05-085303f63723', 'volume_name': 'volume-d22ae147-ba31-4f0b-8f05-085303f63723', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118477bc-83a5-4e1c-8c58-a628a51e4234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118477bc-83a5-4e1c-8c58-a628a51e4234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed570ac-36a6-4c04-8591-ac65da21f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume d22ae147-ba31-4f0b-8f05-085303f63723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22ae147-ba31-4f0b-8f05-085303f63723', 'volume_size': 1}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:49 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17" returned: 0 in 0.804s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:49 devstack sudo[89087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17
Apr 10 10:40:49 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:49 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc" returned: 0 in 0.749s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:49 devstack sudo[89092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9
Apr 10 10:40:49 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (a59d917e-64eb-4fa0-ac17-897fd27eaa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6497084-a22a-4971-82ba-86cd0a471788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6497084-a22a-4971-82ba-86cd0a471788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1232387883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da57a85d-e0e7-4a4b-8461-8227417a7a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408fe74eb6540369fef8216fcbfa98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:50Z,use_quota=True,user_id='a153f7f5a67c4c5a930e938bac386f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169bbcfd-87b1-4b55-a5ea-304358d7e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169bbcfd-87b1-4b55-a5ea-304358d7e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa48dd4-5144-40bf-a559-dfdc6416e66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa48dd4-5144-40bf-a559-dfdc6416e66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'da57a85d-e0e7-4a4b-8461-8227417a7a0c', 'volume_name': 'volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c', 'volume_size': 1, 'source_volid': 'd892b4a0-bf47-42fa-a1b2-0b87e95d1e7c', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363bdcb7-ab05-4e8d-a166-7820c4a4d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:49 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363bdcb7-ab05-4e8d-a166-7820c4a4d81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7c4f18-6ee3-4c03-97c9-75d2ced83fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:50 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Volume da57a85d-e0e7-4a4b-8461-8227417a7a0c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c', 'volume_size': 1, 'source_volid': 'd892b4a0-bf47-42fa-a1b2-0b87e95d1e7c', 'source_volstatus': 'available'}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:50 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-52521027-b929-4b8a-ac69-22070eea4c17" returned: 0 in 0.452s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-52521027-b929-4b8a-ac69-22070eea4c17" released by "delete_volume" :: held 1.295s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created reservations ['2807265e-5395-415f-8149-744519ebc39a', '34823aba-5ca8-4a98-92e4-81de9219064e', '712254a1-c860-4d74-8361-f1c0e1397cb1', 'd0863f07-77aa-46cf-afb8-766f351b04b1'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:50 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:50 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:50 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.536s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:50 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Deleted volume successfully.
Apr 10 10:40:50 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ae439682-c86a-49dd-ae97-5875d9c32f85 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-52521027-b929-4b8a-ac69-22070eea4c17-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:51 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea" acquired by "delete_volume" :: waited 0.023s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:51 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea4486-73d9-44da-8525-470679a1e79c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:51 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:51 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea
Apr 10 10:40:51 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:52 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:52 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" returned: 0 in 2.693s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea" returned: 0 in 1.309s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:52 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[72717cd3-6ee2-4605-a408-0e1f085f2be2]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:52 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:52 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea
Apr 10 10:40:52 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:52 devstack sudo[89114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc
Apr 10 10:40:52 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:53 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea" returned: 0 in 0.481s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea" released by "delete_volume" :: held 1.837s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created reservations ['b975828d-8a12-415f-afae-f2d1e2d56f6d', '97ab1530-7c8c-401e-9d0b-417b7d976ee9', '8d2275c6-ea92-4708-a262-d6d808149fd6', '88d2c941-530a-483e-86da-67ff4879e42f'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:53 devstack sudo[89120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:53 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:53 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc" returned: 0 in 0.668s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc, size 1024.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:40:53 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Converted 1024.00 MB image at 380.10 MB/s
Apr 10 10:40:53 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 is being set with open permissions: ugo+rw
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:53 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9
Apr 10 10:40:53 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Deleting offline snapshot 4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 of volume 9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] snapshot_file for this snap is: volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[46682b0c-2b1d-4f7a-86f7-157dc91a4e3d]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:53 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592
Apr 10 10:40:53 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:53 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.476s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:53 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Deleted volume successfully.
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-79314539-44dd-4077-9b3d-0df8bfd0c800 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-4bcf9d7f-c849-4ec9-a4f1-5e116cb73eea-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:53 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" returned: 0 in 0.471s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" released by "_copy_volume_from_snapshot" :: held 5.380s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-036784fc-fc20-4e50-828b-00f755ba9b22-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" released by "_create_volume_from_snapshot" :: held 5.418s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.432s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.114s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-492297596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95b6b32-ffbf-45ab-81c6-fd98a37f66fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Creating volume c95b6b32-ffbf-45ab-81c6-fd98a37f66fd {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:53 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:53 devstack sudo[89129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd 1073741824
Apr 10 10:40:53 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b722b48b-b892-469e-818a-b6b68c2e8fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9', 'volume_size': 1, 'snapshot_id': '036784fc-fc20-4e50-828b-00f755ba9b22'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32957171-fead-491a-8a33-9f0a9c2bc614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:53 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Volume volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 (22f8a0e2-9437-4290-a97a-5619ea0bc3f9): created successfully
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32957171-fead-491a-8a33-9f0a9c2bc614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:53 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Flow 'volume_create_manager' (ae355a22-cea2-4c20-ac92-e0d1a7471581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:53 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-4a11786c-7a94-4141-a842-7f0e037eaa1e tempest-SnapshotDependencyTests-1865100927 None] Created volume successfully.
Apr 10 10:40:54 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" returned: 0 in 0.511s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc939b-4312-4b83-98ba-a8b92bad3869]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:54 devstack sudo[89134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc
Apr 10 10:40:54 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:54 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd 1073741824" returned: 0 in 0.542s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:54 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd
Apr 10 10:40:54 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:54 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" returned: 0 in 0.476s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:54 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592
Apr 10 10:40:54 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:54 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd" returned: 0 in 0.414s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.943s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208892438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Creating volume a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:54 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d30c105-98f9-4616-b80b-b0c1cb18c085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:54 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 1073741824
Apr 10 10:40:54 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e2efc6-2c74-4231-a78a-07516c279076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:54 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd (c95b6b32-ffbf-45ab-81c6-fd98a37f66fd): created successfully
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e2efc6-2c74-4231-a78a-07516c279076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:54 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (8d2647e1-b36d-4df9-9a5a-cf04f5b999a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:54 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e07679c7-f651-4943-9af0-037e421d4e66 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created volume successfully.
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-036784fc-fc20-4e50-828b-00f755ba9b22-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-036784fc-fc20-4e50-828b-00f755ba9b22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-quobyte-97608e0e-d37e-4882-ac3f-48dcd56f90fc" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-97608e0e-d37e-4882-ac3f-48dcd56f90fc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-quobyte-036784fc-fc20-4e50-828b-00f755ba9b22" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-036784fc-fc20-4e50-828b-00f755ba9b22" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Deleting offline snapshot 036784fc-fc20-4e50-828b-00f755ba9b22 of volume 97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:40:55 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] snapshot_file for this snap is: volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" returned: 0 in 0.560s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22179e6-9e0e-4f17-94bc-76764f0a4c9c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:55 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592
Apr 10 10:40:55 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:55 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22
Apr 10 10:40:55 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:55 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 1073741824" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:55 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07
Apr 10 10:40:55 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:55 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc.4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" returned: 0 in 0.465s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592" released by "_delete_snapshot" :: held 2.079s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" released by "delete_snapshot" :: held 2.097s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created reservations ['1c19b738-dc27-4372-9929-a91c9a87c8ae', '64aa1e4d-dfbc-4e59-8c85-99f694f93fef', 'ea623476-34c9-4530-9db4-12af8aa9f1f4', 'b464f991-59a4-4575-9782-712a3f39b8a0'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:55 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22" returned: 0 in 0.569s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:40:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Delete snapshot completed successfully.
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-38df5a51-792d-40b3-8587-cb765a3af731 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-4a3d7f2a-58ff-4f04-8f1c-7e9ccdefe592-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba5375-ac48-4c16-8174-a91c0614a664]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:55 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc
Apr 10 10:40:55 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:55 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07" returned: 0 in 0.455s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.710s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1981125669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707c41f0-a17b-4c5b-ba19-c2b868c20507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Creating volume 707c41f0-a17b-4c5b-ba19-c2b868c20507 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:55 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537abe54-85e0-42df-92d4-fa7466de0256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:55 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507 1073741824
Apr 10 10:40:55 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf58e263-5ad9-4419-9a91-158cbcfe32bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:55 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 (a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07): created successfully
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf58e263-5ad9-4419-9a91-158cbcfe32bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:55 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (3fec550f-4164-4ca0-b4a5-fe719c5fdfcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:55 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-5bf756d2-6059-47c2-859f-f9c47ed54003 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created volume successfully.
Apr 10 10:40:56 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc" returned: 0 in 0.543s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:56 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22
Apr 10 10:40:56 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:56 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507 1073741824" returned: 0 in 0.560s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:56 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507
Apr 10 10:40:56 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "cinder-quobyte-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" acquired by "delete_volume" :: waited 0.021s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[f690be27-9bf2-46aa-8228-b4adfaac58c9]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:56 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22" returned: 0 in 0.570s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:56 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc
Apr 10 10:40:56 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:56 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22
Apr 10 10:40:56 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:56 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507" returned: 0 in 0.483s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.404s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988661090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3507b85c-e46e-4b5f-af51-fce816c79563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:49Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Creating volume 3507b85c-e46e-4b5f-af51-fce816c79563 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:56 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6348d4a-d45c-483a-9df6-d16bfdfa9e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707c41f0-a17b-4c5b-ba19-c2b868c20507', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2acccd0-6f7f-4de9-90a5-7418cb539505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:56 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563 1073741824
Apr 10 10:40:56 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:56 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume volume-707c41f0-a17b-4c5b-ba19-c2b868c20507 (707c41f0-a17b-4c5b-ba19-c2b868c20507): created successfully
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2acccd0-6f7f-4de9-90a5-7418cb539505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:56 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (c7c7b867-4b3e-418d-b0c7-d3514cf6a200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:56 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-042fdfa4-b84e-4ad6-92e5-cfe12310a490 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created volume successfully.
Apr 10 10:40:57 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc.036784fc-fc20-4e50-828b-00f755ba9b22" returned: 0 in 0.476s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:57 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" returned: 0 in 0.566s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-036784fc-fc20-4e50-828b-00f755ba9b22" released by "_delete_snapshot" :: held 2.237s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-97608e0e-d37e-4882-ac3f-48dcd56f90fc" released by "delete_snapshot" :: held 2.252s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:57 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc
Apr 10 10:40:57 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Created reservations ['6a5a1fe9-7d32-4bfd-ac87-3d402d10321b', '8da8862a-f1b3-407f-89f3-46804690ecd0', 'afaf9040-6e6d-4c3c-ab1a-674bb9208bff', '3cd9563a-9d37-4207-9f13-2248be873819'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:57 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Delete snapshot completed successfully.
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-aa6cf293-c545-4be2-a16b-8578227e9c8b tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-036784fc-fc20-4e50-828b-00f755ba9b22-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:57 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563 1073741824" returned: 0 in 0.598s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:57 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563
Apr 10 10:40:57 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:57 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" returned: 0 in 0.450s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-quobyte-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc" released by "delete_volume" :: held 1.051s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Created reservations ['690ea34f-03db-4e31-bb39-fb2d65fb2383', '05fe630f-a075-4ac7-82c6-1d40bd59f8e5', 'eb90a36c-f4bf-4366-82b4-5ecf0daf1e59', 'f1d1069b-82d1-461d-ac92-715b714668bd'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:57 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:57 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:57 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:58 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563" returned: 0 in 0.442s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.360s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1054382064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22ae147-ba31-4f0b-8f05-085303f63723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb7c3a38bd4cda92dbf58bdef8749e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:50Z,use_quota=True,user_id='075fac6a540644e285e3be474cefb61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Creating volume d22ae147-ba31-4f0b-8f05-085303f63723 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:40:58 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee6a01d-ba80-4744-8d82-b4e9d6ed6c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3507b85c-e46e-4b5f-af51-fce816c79563', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:58 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723 1073741824
Apr 10 10:40:58 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2027752-de21-4973-b7a6-c8f76b8954ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:58 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume volume-3507b85c-e46e-4b5f-af51-fce816c79563 (3507b85c-e46e-4b5f-af51-fce816c79563): created successfully
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2027752-de21-4973-b7a6-c8f76b8954ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (0475ad0f-38a4-443a-8ca1-2a3ecf1dfa84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:58 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-83f13715-f99d-4646-aec1-283a5edef8ce tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created volume successfully.
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-97608e0e-d37e-4882-ac3f-48dcd56f90fc-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-97608e0e-d37e-4882-ac3f-48dcd56f90fc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-quobyte-97608e0e-d37e-4882-ac3f-48dcd56f90fc" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-97608e0e-d37e-4882-ac3f-48dcd56f90fc" acquired by "delete_volume" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d49da9c-f820-41c7-9534-dc80c26eb97c]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:58 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.455s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:58 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Deleted volume successfully.
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ee30aa22-08ab-4b16-9f1a-4b0fad342b82 tempest-CreateVolumesFromSnapshotTest-152954993 None] Lock "cinder-9c526d6d-066e-4a26-bf0a-1dc993ddb5cc-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:58 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc
Apr 10 10:40:58 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:58 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723 1073741824" returned: 0 in 0.610s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:58 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723
Apr 10 10:40:58 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:58 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc" returned: 0 in 0.535s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:58 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:58 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc
Apr 10 10:40:58 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:59 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723" returned: 0 in 0.473s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.123s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:59 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Cloning volume d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c to volume da57a85d-e0e7-4a4b-8461-8227417a7a0c
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Creating offline snapshot d7776d34-28b2-45be-91e8-017b3626508a of volume d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed570ac-36a6-4c04-8591-ac65da21f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22ae147-ba31-4f0b-8f05-085303f63723', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22b0e6f-717e-443e-8a7a-00248ba796f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[832b3337-17ea-43d8-9d17-ddb72160f59a]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:59 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Volume volume-d22ae147-ba31-4f0b-8f05-085303f63723 (d22ae147-ba31-4f0b-8f05-085303f63723): created successfully
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22b0e6f-717e-443e-8a7a-00248ba796f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Flow 'volume_create_manager' (081cbcf0-63aa-4b99-bf21-106539413c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:40:59 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-bd337d28-a902-46b2-b286-ea0121cd636d tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created volume successfully.
Apr 10 10:40:59 devstack sudo[89256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c
Apr 10 10:40:59 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:59 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-97608e0e-d37e-4882-ac3f-48dcd56f90fc" returned: 0 in 0.473s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-97608e0e-d37e-4882-ac3f-48dcd56f90fc" released by "delete_volume" :: held 1.043s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Created reservations ['83386b6a-bef2-468c-a2a7-04e6bdfc2703', 'fd3e016d-823a-484c-bf75-a59fce91ca5b', 'fbc251b5-c0b7-4e31-87b6-e36126b66b31', '97f3bf91-92bf-4969-a2bb-2e9853c3bdbe'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:59 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:40:59 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-d22ae147-ba31-4f0b-8f05-085303f63723-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-d22ae147-ba31-4f0b-8f05-085303f63723-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-quobyte-d22ae147-ba31-4f0b-8f05-085303f63723" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-d22ae147-ba31-4f0b-8f05-085303f63723" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af535f1-fc61-495f-9e52-c42bcdedeff5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:59 devstack sudo[89261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723
Apr 10 10:40:59 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:59 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" returned: 0 in 0.685s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:40:59 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a 1G
Apr 10 10:40:59 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:40:59 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.588s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:40:59 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:40:59 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Deleted volume successfully.
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-ab471904-f5a0-46f8-8704-5ad35dcf6df5 tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-97608e0e-d37e-4882-ac3f-48dcd56f90fc-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:00 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723" returned: 0 in 0.688s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:00 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723
Apr 10 10:41:00 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-22f8a0e2-9437-4290-a97a-5619ea0bc3f9-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-22f8a0e2-9437-4290-a97a-5619ea0bc3f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "cinder-quobyte-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:00 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a 1G" returned: 0 in 0.652s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4624b9-91b5-493d-9550-fa715267a682]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:00 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a
Apr 10 10:41:00 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:00 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9
Apr 10 10:41:00 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:00 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d22ae147-ba31-4f0b-8f05-085303f63723" returned: 0 in 0.477s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-d22ae147-ba31-4f0b-8f05-085303f63723" released by "delete_volume" :: held 1.194s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created reservations ['08e1d44f-ddf9-469c-baa7-a14a6ad69fff', '9321b423-3a16-463c-ade1-aa5761030634', '6e68d1f5-4601-47aa-bec7-10643d2c5134', 'e53392d3-8907-47b1-a608-0ac9583b81e5'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:00 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:00 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:00 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a" returned: 0 in 0.470s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:00 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a is being set with open permissions: ugo+rw
Apr 10 10:41:00 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:01 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a
Apr 10 10:41:01 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:01 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" returned: 0 in 0.578s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:01 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9
Apr 10 10:41:01 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:01 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.470s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:01 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Deleted volume successfully.
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-0fb65f8f-b6f5-48f9-abdf-44b101ebcfa3 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-d22ae147-ba31-4f0b-8f05-085303f63723-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:01 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a" returned: 0 in 0.447s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:01 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.info
Apr 10 10:41:01 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:01 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" returned: 0 in 0.422s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-quobyte-22f8a0e2-9437-4290-a97a-5619ea0bc3f9" released by "delete_volume" :: held 1.042s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Created reservations ['8737c712-5de1-4899-87b6-288b3cb57972', '6680ca65-50e8-4c23-a8c8-de991ed7260f', '4c81c188-a01d-43ea-aa89-28d9e012a0e6', 'aa32ff4f-6cea-41d8-b2d6-2f492e3c0569'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:01 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:01 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-3507b85c-e46e-4b5f-af51-fce816c79563-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-3507b85c-e46e-4b5f-af51-fce816c79563-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-quobyte-3507b85c-e46e-4b5f-af51-fce816c79563" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-3507b85c-e46e-4b5f-af51-fce816c79563" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[de777545-89b3-4d43-8a22-e1ce711b8444]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:01 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563
Apr 10 10:41:01 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:01 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.info" returned: 0 in 0.454s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:01 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.info is being set with open permissions: ugo+rw
Apr 10 10:41:01 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:01 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.info
Apr 10 10:41:01 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:02 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.441s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:02 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Deleted volume successfully.
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-942bbe7e-e406-4904-89ef-2bb06d1bb28e tempest-SnapshotDependencyTests-1865100927 None] Lock "cinder-22f8a0e2-9437-4290-a97a-5619ea0bc3f9-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:02 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563" returned: 0 in 0.519s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:02 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563
Apr 10 10:41:02 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:02 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.info" returned: 0 in 0.441s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-da57a85d-e0e7-4a4b-8461-8227417a7a0c" by "_copy_volume_from_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-da57a85d-e0e7-4a4b-8461-8227417a7a0c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] snapshot: d7776d34-28b2-45be-91e8-017b3626508a, volume: da57a85d-e0e7-4a4b-8461-8227417a7a0c,  {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[10530a4c-cc54-4a3f-8ec1-95397c2878c5]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:02 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a
Apr 10 10:41:02 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:02 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-3507b85c-e46e-4b5f-af51-fce816c79563" returned: 0 in 0.447s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-3507b85c-e46e-4b5f-af51-fce816c79563" released by "delete_volume" :: held 0.990s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created reservations ['890a029f-d513-4031-88db-42745ac28fcb', '47a00407-5f4a-4895-ae80-161dc631d6df', '4d8814c4-04ea-4587-8ebd-bc196b373c2c', '2bb88204-4b5e-466d-aef1-e3d6b715cb90'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:02 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a" returned: 0 in 0.501s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Creating direct copy from snapshot {{(pid=81969) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[18571744-489a-428e-83a0-b866c0fbb4d7]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:02 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:02 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:02 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:02 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c
Apr 10 10:41:02 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:03 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.418s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:03 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Deleted volume successfully.
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e5a7e2f3-4043-4faa-be6e-5edaf4c0ff93 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-3507b85c-e46e-4b5f-af51-fce816c79563-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:03 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" returned: 0 in 0.626s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG cinder.utils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Path /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c not found in is_blk_device check {{(pid=81969) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:03 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c
Apr 10 10:41:03 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-707c41f0-a17b-4c5b-ba19-c2b868c20507-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:03 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-707c41f0-a17b-4c5b-ba19-c2b868c20507-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-quobyte-707c41f0-a17b-4c5b-ba19-c2b868c20507" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:04 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-707c41f0-a17b-4c5b-ba19-c2b868c20507" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:04 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[25697a34-f640-4d02-97c6-51a28c846c90]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:04 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:04 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507
Apr 10 10:41:04 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:05 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507" returned: 0 in 1.001s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:05 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:05 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507
Apr 10 10:41:05 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:06 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-707c41f0-a17b-4c5b-ba19-c2b868c20507" returned: 0 in 1.061s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-707c41f0-a17b-4c5b-ba19-c2b868c20507" released by "delete_volume" :: held 2.104s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created reservations ['9d7fceed-1ec7-4efd-b7b5-5ecef4c74740', '1632c767-f94d-48e2-88a1-a0407e094e71', '3fe11df4-05ae-4718-8778-0c2d50059ea2', '9076fafb-288a-462d-8117-210b51c3d1ca'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:06 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c" returned: 0 in 2.738s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:06 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:06 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[997e232d-1c8f-42b8-bdab-814d16bbedec]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:06 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c
Apr 10 10:41:06 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:06 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.536s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:06 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Deleted volume successfully.
Apr 10 10:41:06 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-d15e6663-751f-40fb-8059-77654bb03810 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-707c41f0-a17b-4c5b-ba19-c2b868c20507-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:07 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" returned: 0 in 0.801s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.image.image_utils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c, size 1024.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c {{(pid=81969) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 10:41:07 devstack cinder-volume[81969]: INFO cinder.image.image_utils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Converted 1024.00 MB image at 373.80 MB/s
Apr 10 10:41:07 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c is being set with open permissions: ugo+rw
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:07 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c
Apr 10 10:41:07 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-quobyte-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[078938e5-ebbe-46f3-994d-6527031aec7f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:07 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07
Apr 10 10:41:07 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:07 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c" returned: 0 in 0.482s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-da57a85d-e0e7-4a4b-8461-8227417a7a0c" released by "_copy_volume_from_snapshot" :: held 5.200s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-d7776d34-28b2-45be-91e8-017b3626508a" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-d7776d34-28b2-45be-91e8-017b3626508a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Deleting offline snapshot d7776d34-28b2-45be-91e8-017b3626508a of volume d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] snapshot_file for this snap is: volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bcd676-6257-4f68-a50a-90c354d9e42e]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:07 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a
Apr 10 10:41:07 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:07 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07" returned: 0 in 0.581s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:07 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:07 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07
Apr 10 10:41:07 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:08 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a" returned: 0 in 0.562s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d7ba1-ffda-4dd5-a308-647717acc3b0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:08 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c
Apr 10 10:41:08 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:08 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07" returned: 0 in 0.441s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07" released by "delete_volume" :: held 1.051s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created reservations ['a16b8d45-a609-4477-927f-cecd77333824', 'dedec6ca-0e30-4edc-8897-f7ce2e051138', 'd0253a41-48ce-4141-81ee-e2c0c51718d3', '70cbe23e-8a4c-4551-ba09-99982607f0b9'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:08 devstack sudo[89376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:08 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:08 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" returned: 0 in 0.573s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:08 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:08 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a
Apr 10 10:41:08 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:09 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.551s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:09 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Deleted volume successfully.
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-2a3c78be-a289-4564-a5c8-ee6318e72a4f tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-a7b208ae-96c3-4a55-ad6d-aa0f01e9ee07-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:09 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a" returned: 0 in 0.530s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:09 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a
Apr 10 10:41:09 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-quobyte-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d8d21-bbea-447b-bc0c-c8aab68da671]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:09 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd
Apr 10 10:41:09 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:09 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c.d7776d34-28b2-45be-91e8-017b3626508a" returned: 0 in 0.507s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-d7776d34-28b2-45be-91e8-017b3626508a" released by "_delete_snapshot" :: held 2.222s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.709s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7c4f18-6ee3-4c03-97c9-75d2ced83fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c', 'volume_size': 1, 'source_volid': 'd892b4a0-bf47-42fa-a1b2-0b87e95d1e7c', 'source_volstatus': 'available'}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de9c5d7-f158-4dcd-97be-0109c2639f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:09 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Volume volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c (da57a85d-e0e7-4a4b-8461-8227417a7a0c): created successfully
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de9c5d7-f158-4dcd-97be-0109c2639f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:09 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Flow 'volume_create_manager' (a59d917e-64eb-4fa0-ac17-897fd27eaa65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:41:09 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-6db9ff1c-7d1f-41f1-844e-b6b3f3a8cf0f tempest-VolumeDependencyTests-1096015566 None] Created volume successfully.
Apr 10 10:41:10 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd" returned: 0 in 0.518s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:10 devstack sudo[89397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd
Apr 10 10:41:10 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" acquired by "delete_volume" :: waited 0.023s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81c2b0f-a749-4e01-a597-48ae1c76c990]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:10 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c
Apr 10 10:41:10 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:10 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd" returned: 0 in 0.526s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd" released by "delete_volume" :: held 1.070s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created reservations ['ba5a02e7-f941-414c-9fe5-b246176d16b5', 'ca77d130-932b-49d5-b141-281633c73404', 'b4074d8a-aede-4067-8674-571517931589', '774aa199-68a3-4bc7-b76c-ce2907e13953'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:10 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:10 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:10 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:11 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" returned: 0 in 0.724s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:11 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c
Apr 10 10:41:11 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:11 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.542s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:11 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Deleted volume successfully.
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-a6920213-eadb-4c38-9436-20af38c226f1 tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-c95b6b32-ffbf-45ab-81c6-fd98a37f66fd-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:11 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" returned: 0 in 0.510s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c" released by "delete_volume" :: held 1.265s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Created reservations ['640327ad-f8d0-413e-bc6f-b6e86d1272e7', '1e3ef954-d37d-4bee-9bfb-062fa48a0ca4', 'e4e2bab4-484f-4cef-b939-93095e22009c', '0b22070d-9d13-4b6c-8c0c-85a2eaf44d89'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-10fda0ff-319f-4418-a7da-bb667bb9de21-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-10fda0ff-319f-4418-a7da-bb667bb9de21-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:11 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:11 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "cinder-quobyte-10fda0ff-319f-4418-a7da-bb667bb9de21" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-10fda0ff-319f-4418-a7da-bb667bb9de21" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3943b8-7ced-4632-8017-6a3956a2460b]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:11 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:11 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21
Apr 10 10:41:11 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:12 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.521s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:12 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Deleted volume successfully.
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f9440449-7860-493c-9d21-46f35c5c3f37 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-d892b4a0-bf47-42fa-a1b2-0b87e95d1e7c-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:12 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21" returned: 0 in 0.568s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:12 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21
Apr 10 10:41:12 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-da57a85d-e0e7-4a4b-8461-8227417a7a0c-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-da57a85d-e0e7-4a4b-8461-8227417a7a0c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-da57a85d-e0e7-4a4b-8461-8227417a7a0c" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-da57a85d-e0e7-4a4b-8461-8227417a7a0c" acquired by "delete_volume" :: waited 0.006s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[575f2ba6-9425-497a-80f8-53f04fbe6051]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:12 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c
Apr 10 10:41:12 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:12 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-10fda0ff-319f-4418-a7da-bb667bb9de21" returned: 0 in 0.461s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-quobyte-10fda0ff-319f-4418-a7da-bb667bb9de21" released by "delete_volume" :: held 1.054s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Created reservations ['3f6fbeba-866f-4caa-a576-09088052e523', '28bc3c2b-3459-41e0-b4a5-b7b0f5dbd353', 'c1caebf1-a577-47ae-a84f-b8c5f8705256', 'd70d4e0d-d7c1-46f1-ac80-5d6ade85c839'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:12 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:12 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:12 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:13 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c" returned: 0 in 0.546s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:13 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c
Apr 10 10:41:13 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:13 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.438s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:13 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Deleted volume successfully.
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-abc0de3f-0e87-4c40-9a8b-9ac5459c291c tempest-CreateVolumesFromSourceVolumeTest-969434107 None] Lock "cinder-10fda0ff-319f-4418-a7da-bb667bb9de21-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:13 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-da57a85d-e0e7-4a4b-8461-8227417a7a0c" returned: 0 in 0.434s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-da57a85d-e0e7-4a4b-8461-8227417a7a0c" released by "delete_volume" :: held 1.020s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:UPDATE=250,cinder:SELECT=173,cinder:INSERT=73,cinder:DELETE=24 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Created reservations ['4cc2d893-8589-4636-b5ca-e60df196dc34', 'e4f6ed14-49a6-4182-bcaf-586d62479267', '40fdc47d-d2e9-4ed7-849a-801f65f92cb0', '43782796-bc99-4c08-a01e-dd3ac9990926'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:13 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:14 devstack sudo[89433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:14 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:14 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.473s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:14 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Deleted volume successfully.
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-f19f2d81-7ebd-4148-8859-32eccd4614de tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-da57a85d-e0e7-4a4b-8461-8227417a7a0c-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-38e7cf42-1515-4595-bb38-657478c04db7-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-38e7cf42-1515-4595-bb38-657478c04db7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG dbcounter [-] [81969] Writing DB stats cinder:SELECT=200,cinder:UPDATE=277,cinder:DELETE=23,cinder:INSERT=53 {{(pid=81969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "cinder-quobyte-38e7cf42-1515-4595-bb38-657478c04db7" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-38e7cf42-1515-4595-bb38-657478c04db7" acquired by "delete_volume" :: waited 0.022s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c68e3bf-0cd2-426a-9094-a78c88c819a6]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:14 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:14 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7
Apr 10 10:41:14 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:15 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7" returned: 0 in 0.494s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:15 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7
Apr 10 10:41:15 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:15 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-38e7cf42-1515-4595-bb38-657478c04db7" returned: 0 in 0.425s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-quobyte-38e7cf42-1515-4595-bb38-657478c04db7" released by "delete_volume" :: held 0.941s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Created reservations ['55cbd732-fe8a-4e5b-ab13-114c988085af', '5c51cd85-8cdb-4246-aa52-948c2d49b121', '9e2f5f7c-382e-420f-b58f-6471db3719b0', 'b2be8b94-fbd1-45e7-901c-5ed53f698acc'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Flow 'volume_create_manager' (1bdd881a-3a9c-4a71-8a07-fe74034cc72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea8d2a1-d646-45ed-a09f-04a1fa608d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea8d2a1-d646-45ed-a09f-04a1fa608d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7391537-75e7-49a3-a467-1b0e36631637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174c64be5d194d5f8136b76a6ec2d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:16Z,use_quota=True,user_id='5791460edfdc4b148e245bae7a9d3f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a72db3-311e-4e73-abe5-a8a4f87d4f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a72db3-311e-4e73-abe5-a8a4f87d4f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:15 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:15 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57e7ce6-b690-40c1-80ba-b63e4d83665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57e7ce6-b690-40c1-80ba-b63e4d83665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7391537-75e7-49a3-a467-1b0e36631637', 'volume_name': 'volume-e7391537-75e7-49a3-a467-1b0e36631637', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31db068-0441-4973-b548-4c3614eeac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31db068-0441-4973-b548-4c3614eeac84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f922759-6cd4-4cf9-afda-ae3908cdb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:15 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Volume e7391537-75e7-49a3-a467-1b0e36631637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7391537-75e7-49a3-a467-1b0e36631637', 'volume_size': 1}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7391537-75e7-49a3-a467-1b0e36631637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174c64be5d194d5f8136b76a6ec2d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:16Z,use_quota=True,user_id='5791460edfdc4b148e245bae7a9d3f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Creating volume e7391537-75e7-49a3-a467-1b0e36631637 {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:41:15 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:41:15 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:15 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637 1073741824
Apr 10 10:41:15 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:16 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.467s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:16 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:16 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Deleted volume successfully.
Apr 10 10:41:16 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-e7dcadf9-e503-44b9-8a21-b80d66e63212 tempest-VolumeDependencyTests-1096015566 None] Lock "cinder-38e7cf42-1515-4595-bb38-657478c04db7-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:16 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637 1073741824" returned: 0 in 0.587s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:16 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:16 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637
Apr 10 10:41:16 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:17 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637" returned: 0 in 0.500s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:17 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:41:17 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f922759-6cd4-4cf9-afda-ae3908cdb91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7391537-75e7-49a3-a467-1b0e36631637', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7e633f-8a7c-452c-80c5-cbad26c6b19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:17 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Volume volume-e7391537-75e7-49a3-a467-1b0e36631637 (e7391537-75e7-49a3-a467-1b0e36631637): created successfully
Apr 10 10:41:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7e633f-8a7c-452c-80c5-cbad26c6b19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:17 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Flow 'volume_create_manager' (1bdd881a-3a9c-4a71-8a07-fe74034cc72d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:41:17 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-1872e986-4144-45f9-ae89-709e9952070c tempest-CinderUnicodeTest-1061301606 None] Created volume successfully.
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.flows.manager.create_volume [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81969) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Flow 'volume_create_manager' (8c116464-75dc-4c20-8d63-b25881b83cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1e60ed-cffa-416a-923e-95da4736fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1e60ed-cffa-416a-923e-95da4736fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:41:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1467466786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e1be4d-a3a5-42fe-9f65-df08c61995fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174c64be5d194d5f8136b76a6ec2d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:18Z,use_quota=True,user_id='5791460edfdc4b148e245bae7a9d3f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f266df8-92d2-49b0-b5a9-85ebaf5a8037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f266df8-92d2-49b0-b5a9-85ebaf5a8037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeebe97-45ea-47b7-90b0-20d3d893acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeebe97-45ea-47b7-90b0-20d3d893acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e1be4d-a3a5-42fe-9f65-df08c61995fd', 'volume_name': 'volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9759f4e-fd2c-4807-be99-c63923adf8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9759f4e-fd2c-4807-be99-c63923adf8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d545be10-e039-4050-aa03-2e4ac8a0bb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:18 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Volume 81e1be4d-a3a5-42fe-9f65-df08c61995fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd', 'volume_size': 1}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f78e2f28130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T08:41:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1467466786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e1be4d-a3a5-42fe-9f65-df08c61995fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174c64be5d194d5f8136b76a6ec2d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:18Z,use_quota=True,user_id='5791460edfdc4b148e245bae7a9d3f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e5eb145-3e52-4555-81ec-c6d5e42ab017),volume_type_id=0e5eb145-3e52-4555-81ec-c6d5e42ab017)}" {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Creating volume 81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Selected osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98 as target Quobyte volume. {{(pid=81969) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 10:41:18 devstack cinder-volume[81969]: INFO cinder.volume.drivers.remotefs [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] casted to osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd 1073741824 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:18 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd 1073741824
Apr 10 10:41:18 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:18 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd 1073741824" returned: 0 in 0.494s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:18 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:18 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd
Apr 10 10:41:18 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:19 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd" returned: 0 in 0.408s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:19 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'} {{(pid=81969) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 10:41:19 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d545be10-e039-4050-aa03-2e4ac8a0bb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd', 'volume_size': 1}' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901618ef-0be0-4f7b-92ce-f90c61f0bdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 10:41:19 devstack cinder-volume[81969]: INFO cinder.volume.flows.manager.create_volume [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Volume volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd (81e1be4d-a3a5-42fe-9f65-df08c61995fd): created successfully
Apr 10 10:41:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901618ef-0be0-4f7b-92ce-f90c61f0bdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81969) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 10:41:19 devstack cinder-volume[81969]: DEBUG cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Flow 'volume_create_manager' (8c116464-75dc-4c20-8d63-b25881b83cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81969) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 10:41:19 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-27aa4d04-20c6-4ee8-bcb1-d84050bcf5a3 tempest-CinderUnicodeTest-1061301606 None] Created volume successfully.
Apr 10 10:41:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:20 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Creating offline snapshot 2e5e0c24-04db-4759-84b4-e2c21fb6612f of volume 81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 10:41:20 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff4fc3-88ea-451a-83f6-90af45f27637]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:20 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:20 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd
Apr 10 10:41:20 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:21 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd" returned: 0 in 0.589s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f 1G {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:21 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f 1G
Apr 10 10:41:21 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:21 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f 1G" returned: 0 in 0.554s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:21 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:21 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f
Apr 10 10:41:21 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:22 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd -F qcow2 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f" returned: 0 in 0.451s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:22 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f is being set with open permissions: ugo+rw
Apr 10 10:41:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:22 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f
Apr 10 10:41:22 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:22 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f" returned: 0 in 0.407s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:22 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:22 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.info
Apr 10 10:41:22 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:23 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.info" returned: 0 in 0.413s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:23 devstack cinder-volume[81969]: WARNING cinder.volume.drivers.remotefs [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.info is being set with open permissions: ugo+rw
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.info {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:23 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.info
Apr 10 10:41:23 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:23 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.info" returned: 0 in 0.411s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:23 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-98a4a8c6-42ba-4868-91a1-744126d64d94 tempest-CinderUnicodeTest-1061301606 None] Create snapshot completed successfully
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "cinder-2e5e0c24-04db-4759-84b4-e2c21fb6612f-delete_snapshot" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-2e5e0c24-04db-4759-84b4-e2c21fb6612f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "cinder-quobyte-81e1be4d-a3a5-42fe-9f65-df08c61995fd" by "delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-81e1be4d-a3a5-42fe-9f65-df08c61995fd" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "cinder-quobyte-2e5e0c24-04db-4759-84b4-e2c21fb6612f" by "_delete_snapshot" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-2e5e0c24-04db-4759-84b4-e2c21fb6612f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Deleting offline snapshot 2e5e0c24-04db-4759-84b4-e2c21fb6612f of volume 81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] snapshot_file for this snap is: volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f {{(pid=81969) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e3df83-3293-47c2-8269-de90d2619a57]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:23 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:23 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f
Apr 10 10:41:23 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:24 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f" returned: 0 in 0.463s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:24 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.remotefs [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81969) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 10:41:24 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e2f8dd-2480-4ac6-88f9-bc3e8c6497b0]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:24 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd
Apr 10 10:41:24 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:24 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd" returned: 0 in 0.485s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:24 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:24 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f
Apr 10 10:41:24 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:25 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f" returned: 0 in 0.447s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:25 devstack sudo[89503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f
Apr 10 10:41:25 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:25 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd.2e5e0c24-04db-4759-84b4-e2c21fb6612f" returned: 0 in 0.419s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-2e5e0c24-04db-4759-84b4-e2c21fb6612f" released by "_delete_snapshot" :: held 1.879s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-81e1be4d-a3a5-42fe-9f65-df08c61995fd" released by "delete_snapshot" :: held 1.899s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Created reservations ['264a7450-18e5-4dd3-95e8-39deffbb006b', '9411ada3-a2f8-44f5-b929-42cb928dc49d', '8861e3b2-f786-46bd-832b-d5cb2f2507a3', '801f6556-9d01-4789-bf36-e0dc8ee3ae48'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:25 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Delete snapshot completed successfully.
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-728704c6-3a9f-4e26-8a42-3daf068e256f tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-2e5e0c24-04db-4759-84b4-e2c21fb6612f-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "cinder-81e1be4d-a3a5-42fe-9f65-df08c61995fd-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-81e1be4d-a3a5-42fe-9f65-df08c61995fd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "cinder-quobyte-81e1be4d-a3a5-42fe-9f65-df08c61995fd" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-81e1be4d-a3a5-42fe-9f65-df08c61995fd" acquired by "delete_volume" :: waited 0.007s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f37588-415b-4b58-bbd4-ac92928d59b8]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:25 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:25 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd
Apr 10 10:41:25 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:26 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd" returned: 0 in 0.487s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:26 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd
Apr 10 10:41:26 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:26 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-81e1be4d-a3a5-42fe-9f65-df08c61995fd" returned: 0 in 0.408s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-81e1be4d-a3a5-42fe-9f65-df08c61995fd" released by "delete_volume" :: held 0.932s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Created reservations ['3c49ae4b-a5b3-4f29-ab03-233f4db86517', '3af7e4f7-a9cd-4a8b-b13c-b4b1c2227d1a', 'f3d11e59-e43b-4fba-8717-a72be79bd24d', '3cfa8325-f908-4590-891b-3b2d1618c16d'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:26 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:26 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:26 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "cinder-e7391537-75e7-49a3-a467-1b0e36631637-delete_volume" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-e7391537-75e7-49a3-a467-1b0e36631637-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "cinder-quobyte-e7391537-75e7-49a3-a467-1b0e36631637" by "delete_volume" {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-e7391537-75e7-49a3-a467-1b0e36631637" acquired by "delete_volume" :: waited 0.009s {{(pid=81969) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG oslo.privsep.daemon [-] privsep: reply[240d851a-2003-438d-8bba-b1e1b2edf90f]: (4, 'qcow2') {{(pid=83053) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:27 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637
Apr 10 10:41:27 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:27 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.443s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:27 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Deleted volume successfully.
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fd7779da-3dfb-445b-8c98-7bef43f15588 tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-81e1be4d-a3a5-42fe-9f65-df08c61995fd-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:27 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637" returned: 0 in 0.485s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:27 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637
Apr 10 10:41:27 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:27 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21/volume-e7391537-75e7-49a3-a467-1b0e36631637" returned: 0 in 0.406s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-quobyte-e7391537-75e7-49a3-a467-1b0e36631637" released by "delete_volume" :: held 0.912s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:27 devstack cinder-volume[81969]: DEBUG cinder.quota [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Created reservations ['5aa65843-b3c6-49f2-b3b0-15d18c0e48e4', 'ab497ecf-6ab5-4902-b943-198e2b3a0276', '207ea4f3-165f-4b2e-ad92-19d3d3152f29', 'dd648f77-db7c-4a5b-96ff-8522a37d41e5'] {{(pid=81969) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:28 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:28 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:28 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.496s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 10:41:28 devstack cinder-volume[81969]: INFO cinder.volume.manager [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Deleted volume successfully.
Apr 10 10:41:28 devstack cinder-volume[81969]: DEBUG cinder.coordination [None req-fe048fed-f9bb-4804-8266-cf17d75af53a tempest-CinderUnicodeTest-1061301606 None] Lock "cinder-e7391537-75e7-49a3-a467-1b0e36631637-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=81969) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG oslo_service.periodic_task [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98': None} {{(pid=81969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG cinder.volume.drivers.quobyte [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-58592959-11ed-4b21-9672-a427cb6d5a98'] {{(pid=81969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.lockutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81969) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21 {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 10:41:37 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21
Apr 10 10:41:37 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 10:41:37 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG oslo_concurrency.processutils [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0906caa72bb35eab992488f6ed60c21" returned: 0 in 0.427s {{(pid=81969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 10:41:37 devstack cinder-volume[81969]: DEBUG cinder.manager [None req-65ec907b-cf0c-486f-8af1-91203e09c912 None None] Notifying Schedulers of capabilities ... {{(pid=81969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}